-- Logs begin at Mon 2022-07-18 05:32:31 UTC, end at Mon 2022-07-18 06:41:46 UTC. -- Jul 18 06:02:39.185773 dv-cinder-850015-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 06:02:39.195814 dv-cinder-850015-4-smb devstack@keystone.service[80439]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 06:02:39 2022] *** Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: nodename: dv-cinder-850015-4-smb Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: machine: x86_64 Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: clock source: unix Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: pcre jit disabled Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: detected number of CPU cores: 4 Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: current working directory: / Jul 18 06:02:39.197887 dv-cinder-850015-4-smb devstack@keystone.service[80439]: detected binary path: /usr/bin/uwsgi-core Jul 18 06:02:39.198472 dv-cinder-850015-4-smb devstack@keystone.service[80439]: your processes number limit is 47680 Jul 18 06:02:39.198472 dv-cinder-850015-4-smb devstack@keystone.service[80439]: your memory page size is 4096 bytes Jul 18 06:02:39.198472 dv-cinder-850015-4-smb devstack@keystone.service[80439]: detected max file descriptor number: 2048 Jul 18 06:02:39.198472 dv-cinder-850015-4-smb devstack@keystone.service[80439]: lock engine: pthread robust mutexes Jul 18 06:02:39.198472 dv-cinder-850015-4-smb devstack@keystone.service[80439]: thunder lock: enabled Jul 18 06:02:39.198472 dv-cinder-850015-4-smb devstack@keystone.service[80439]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 06:02:39.198472 dv-cinder-850015-4-smb devstack@keystone.service[80439]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 06:02:39.238954 dv-cinder-850015-4-smb devstack@keystone.service[80439]: Python main interpreter initialized at 0x55b0277e49c0 Jul 18 06:02:39.238954 dv-cinder-850015-4-smb devstack@keystone.service[80439]: python threads support enabled Jul 18 06:02:39.238954 dv-cinder-850015-4-smb devstack@keystone.service[80439]: your server socket listen backlog is limited to 100 connections Jul 18 06:02:39.238954 dv-cinder-850015-4-smb devstack@keystone.service[80439]: your mercy for graceful operations on workers is 90 seconds Jul 18 06:02:39.239311 dv-cinder-850015-4-smb devstack@keystone.service[80439]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 06:02:39.239388 dv-cinder-850015-4-smb devstack@keystone.service[80439]: *** Operational MODE: preforking *** Jul 18 06:02:39.239650 dv-cinder-850015-4-smb devstack@keystone.service[80439]: *** uWSGI is running in multiple interpreter mode *** Jul 18 06:02:39.239650 dv-cinder-850015-4-smb devstack@keystone.service[80439]: spawned uWSGI master process (pid: 80439) Jul 18 06:02:39.239860 dv-cinder-850015-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 06:02:39.240718 dv-cinder-850015-4-smb devstack@keystone.service[80439]: spawned uWSGI worker 1 (pid: 80451, cores: 1) Jul 18 06:02:39.240819 dv-cinder-850015-4-smb devstack@keystone.service[80439]: spawned uWSGI worker 2 (pid: 80452, cores: 1) Jul 18 06:02:39.245004 dv-cinder-850015-4-smb devstack@keystone.service[80439]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 06:02:44.722778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 06:02:44.722778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: from cryptography.utils import int_from_bytes Jul 18 06:02:44.723565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 06:02:44.723565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: from cryptography.utils import int_from_bytes Jul 18 06:02:44.723678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 06:02:44.723678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jul 18 06:02:44.723678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 06:02:44.723678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: from cryptography.utils import int_from_bytes Jul 18 06:02:44.772772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 06:02:44.772950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 06:02:44.773060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 06:02:44.773147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 06:02:44.773226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] command line args: [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 06:02:44.773298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] command line args: [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 06:02:44.773440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 06:02:44.773527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 06:02:44.773625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ================================================================================ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 06:02:44.773709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ================================================================================ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 06:02:44.773876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.773959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] admin_token = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_dir = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config_dir = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] config_source = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] config_source = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] debug = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] debug = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.774848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.775982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_config_append = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_config_append = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_dir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.776891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_dir = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.777884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.778917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.779036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.779111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.779237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.779347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.779436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.779597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.779686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.780493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.780578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.780782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.780909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.781313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.781443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.27/identity {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.781583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] publish_errors = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.781658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] publish_errors = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.781774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.781847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.781969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] standard_threads = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.782898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] standard_threads = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_journal = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_journal = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_json = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_json = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.783967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_stderr = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.784038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_stderr = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.784138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] use_syslog = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.784293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] use_syslog = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.784384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.784454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 06:02:44.784616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.784703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.784853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.784939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.785962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.786942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.787915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.788898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.789909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790172 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.790911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.791846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.792970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.793953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794276 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.794983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.795936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.796836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.797997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.798955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.799910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.800959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.801969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.802921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.803067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.803166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.803304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.803384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.803812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.803895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.804862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805172 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.805862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.806984 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.807090 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.807217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.807322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.807452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.807679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.807766 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.807917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808480 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.808886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.809930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.810129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.810219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.external = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.810363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.810445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.810663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.external = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.810750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.810896 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.password = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] auth.token = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.password = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.811973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.812064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] auth.token = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.812233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.812345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.812491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.812587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.812770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.812850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.813932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.814125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.814204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.814389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.814478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.814712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.814811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.814976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.815055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.815241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.815341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.815523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.815611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.815788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.815960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.816094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.816235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.816382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.816582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.816670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.816877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.816967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.817998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.818158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.818260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.818410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.818498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.818664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.818746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.818918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.819963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.820964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.821918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.822876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.823975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.824948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.825979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.826060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.826214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.826301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.826444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.826545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.827232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.827353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.827470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.827558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.827707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.827851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828561 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.828895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.829874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.830967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.831921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832723 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.832961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.833949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.834900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.835882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.836968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.837966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.838926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.839952 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.840917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.841889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.842046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.842124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.842927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.843985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.844953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.845951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.846891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.847886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.848872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.849885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.850060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.850216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.850460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.850539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.850703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.850781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.850955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.851935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.852908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853260 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.853916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.854944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.855901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.856886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.857857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.858852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.859898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860050 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.860912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.861957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.862995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.863142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.863220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.863376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.863454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.863617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.863704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.863779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80451) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 06:02:44.863851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 06:02:44.864010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 06:02:44.895175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.895339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.895447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.895525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.895623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.895708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.903942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.904050 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.932677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.932836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.932922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:44.933099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.076304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.076490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.126103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.126327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.127480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.127721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.191636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.191862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.192913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.193159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.218548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.218720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.218802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.218896 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.218974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.219958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.231206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.231393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.244493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.244724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.244942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80452) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.245899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.246102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.246320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80451) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 06:02:45.263393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.263601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 06:02:45.263875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.263956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.264092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 06:02:45.264789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 06:02:45.264933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.265124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.265205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.265444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 06:02:45.265525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.265612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.265688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.265835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.266091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.266348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.276726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.277020 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.277290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.277574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.277881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.278163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.278434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.278720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.285799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.287205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.289105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.289387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.289668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.290058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.290341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.290526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.290615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.290807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.290888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.291090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.291169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.291377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.291489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.291651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.291777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.291918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.292049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.292320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.294895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.294895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.294895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.294895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.320019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.321196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.321683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.321966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.322841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.323127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.327891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.328114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.328397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.329048 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.329333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.329616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.335707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.335988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.336907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.337290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.340701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.341010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.341283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.341560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.341831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.341929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.342105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.342189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.342402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.342519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.342670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.342973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.343260 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.343537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.343809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.344078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.361407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.361681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.363067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.363345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.366190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.367888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.369887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.370181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.371643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.371941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.375857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.377542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.379520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.381198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.383285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.383583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.383872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.384152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.384440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.384729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.385004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.385317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.385603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.385895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.386198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.386481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.404385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.404798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.405174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.405450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.406319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.406698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.406984 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.407259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.413401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.415119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.415247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.415390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.416995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.417275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.418450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.418737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.419028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.419320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.419608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.420373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.420674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.420958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.421352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.421640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.433516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.433794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.434075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.434354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.434634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.434924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.435211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.435667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.435944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.436755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.437066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.437346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.437634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.437924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.455902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.457891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.459205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.461198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.462558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.464149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.464494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.465809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.466091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.466174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.466372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.467914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.468193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.468474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.473847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.475479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.475936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.477588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.478747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.479035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.479317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.479591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.480862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.481185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.481473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.481753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.489487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.489715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.489993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.491538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.491826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.492115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.497849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80452) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.498126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.498403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.499254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.499254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.499964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.500239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.500507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.500754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80451) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 06:02:45.500837 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.501958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.502133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80452) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.502215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.502425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.502695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.502966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.503243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.503522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.503785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.504049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.504323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80451) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 06:02:45.540369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0277e49c0 pid: 80452 (default app) Jul 18 06:02:45.542431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b0277e49c0 pid: 80451 (default app) Jul 18 06:02:45.543759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16194d0-8456-4f00-ad3c-ee3b2ef1a018 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:45.544054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16194d0-8456-4f00-ad3c-ee3b2ef1a018 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:45.544335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16194d0-8456-4f00-ad3c-ee3b2ef1a018 None None] PATH_INFO: `/v3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:45.549123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 791 bytes} [Mon Jul 18 06:02:45 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:02:54.165991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909860b-c8cd-479e-8b0b-53fd9797e09c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:54.166560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909860b-c8cd-479e-8b0b-53fd9797e09c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:54.166560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a909860b-c8cd-479e-8b0b-53fd9797e09c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:54.171156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1/2] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:02:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:02:54.176540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:54.176972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:54.177128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:54.246258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: INFO dbcounter [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] Registered counter for database keystone Jul 18 06:02:54.268719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG oslo_db.sqlalchemy.engines [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 06:02:54.274956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writer thread running {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 06:02:54.459078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80452) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 06:02:54.459414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG passlib.handlers.bcrypt [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80452) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 06:02:54.515091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:02:54.516751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:02:54.641893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:02:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 18 06:02:54.812505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909860b-c8cd-479e-8b0b-53fd9797e09c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:54.883275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: INFO dbcounter [None req-a909860b-c8cd-479e-8b0b-53fd9797e09c None None] Registered counter for database keystone Jul 18 06:02:54.903621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG oslo_db.sqlalchemy.engines [None req-a909860b-c8cd-479e-8b0b-53fd9797e09c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80451) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 06:02:54.910604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writer thread running {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 06:02:55.035048 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a909860b-c8cd-479e-8b0b-53fd9797e09c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:02:55.039397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88716262-0886-4e20-8bcb-829bdc74674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:02:55.040145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716262-0886-4e20-8bcb-829bdc74674e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:55.040404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716262-0886-4e20-8bcb-829bdc74674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:55.040689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88716262-0886-4e20-8bcb-829bdc74674e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:55.049392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716262-0886-4e20-8bcb-829bdc74674e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:02:55.102830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING keystone.common.rbac_enforcer.enforcer [None req-88716262-0886-4e20-8bcb-829bdc74674e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 06:02:55.103111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88716262-0886-4e20-8bcb-829bdc74674e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:02:55.113569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Jul 18 06:02:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 06:02:55.122351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:55.141236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05a22a-8b00-4d62-9702-c0d723c422a4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:02:55.148348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4d9d5-54ad-47d6-b6e1-db9656b86f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:02:55.150018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d9d5-54ad-47d6-b6e1-db9656b86f7a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:55.150519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d9d5-54ad-47d6-b6e1-db9656b86f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:55.151013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4d9d5-54ad-47d6-b6e1-db9656b86f7a admin admin] PATH_INFO: `/v3/projects/8a3405aadfe54be0a4fabaa1726d8751` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:55.155439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d9d5-54ad-47d6-b6e1-db9656b86f7a admin admin] RBAC: Authorizing `identity:get_project(project_id=8a3405aadfe54be0a4fabaa1726d8751)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:02:55.209381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bad4d9d5-54ad-47d6-b6e1-db9656b86f7a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 06:02:55.209987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4d9d5-54ad-47d6-b6e1-db9656b86f7a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:02:55.214445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 3/5] 10.222.0.27 () {56 vars in 1207 bytes} [Mon Jul 18 06:02:55 2022] GET /identity/v3/projects/8a3405aadfe54be0a4fabaa1726d8751 => generated 344 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:02:57.266181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582bc4-ea28-4b62-95b3-ef9332ef64b1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:57.266719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582bc4-ea28-4b62-95b3-ef9332ef64b1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:57.266719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05582bc4-ea28-4b62-95b3-ef9332ef64b1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:57.270837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 3/6] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:02:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:02:57.276485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8413-875a-416a-82f7-bd2db761515e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:57.276949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8413-875a-416a-82f7-bd2db761515e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:57.277075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e8413-875a-416a-82f7-bd2db761515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:57.296101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-931e8413-875a-416a-82f7-bd2db761515e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:02:57.297676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-931e8413-875a-416a-82f7-bd2db761515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:02:57.306000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 4/7] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:02:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 06:02:57.329536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582bc4-ea28-4b62-95b3-ef9332ef64b1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:57.341501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05582bc4-ea28-4b62-95b3-ef9332ef64b1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:02:57.345836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5d943-e474-4298-ae04-262b4d38d6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:02:57.346460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d943-e474-4298-ae04-262b4d38d6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:57.346744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d943-e474-4298-ae04-262b4d38d6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:57.347019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5d943-e474-4298-ae04-262b4d38d6bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:57.354685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5d943-e474-4298-ae04-262b4d38d6bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:02:57.356440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5d943-e474-4298-ae04-262b4d38d6bc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:02:57.365362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1324 bytes} [Mon Jul 18 06:02:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:02:57.370936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8413-875a-416a-82f7-bd2db761515e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:57.380799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e8413-875a-416a-82f7-bd2db761515e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:02:57.385355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735b68f-c6b1-4e5d-80d5-5131df87befb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:02:57.386217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b68f-c6b1-4e5d-80d5-5131df87befb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:57.386507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b68f-c6b1-4e5d-80d5-5131df87befb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:57.386790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735b68f-c6b1-4e5d-80d5-5131df87befb admin admin] PATH_INFO: `/v3/users/20e59e7d825648b8a25362d3fc9a5d44` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:57.388195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b68f-c6b1-4e5d-80d5-5131df87befb admin admin] RBAC: Authorizing `identity:get_user(user_id=20e59e7d825648b8a25362d3fc9a5d44)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:02:57.390736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735b68f-c6b1-4e5d-80d5-5131df87befb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:02:57.392325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 5/9] 10.222.0.27 () {56 vars in 1198 bytes} [Mon Jul 18 06:02:57 2022] GET /identity/v3/users/20e59e7d825648b8a25362d3fc9a5d44 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:02:59.477774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540919-afe2-4500-bf90-42ae541d0bfb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:59.478285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540919-afe2-4500-bf90-42ae541d0bfb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:59.478382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe540919-afe2-4500-bf90-42ae541d0bfb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:59.479738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 5/10] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:02:59.485991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abc529-96ec-418c-853a-715132ea2d01 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:59.486475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abc529-96ec-418c-853a-715132ea2d01 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:59.486571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6abc529-96ec-418c-853a-715132ea2d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:59.503609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a6abc529-96ec-418c-853a-715132ea2d01 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:02:59.504801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a6abc529-96ec-418c-853a-715132ea2d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:02:59.549894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b0af-0921-473f-a518-f4e088ad1670 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:59.550178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b0af-0921-473f-a518-f4e088ad1670 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:59.550458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2b0af-0921-473f-a518-f4e088ad1670 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:59.551833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 6/11] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:02:59.557363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:59.557584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:59.557858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:59.587628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:02:59.599809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG passlib.handlers.bcrypt [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80451) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 06:02:59.600222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG passlib.handlers.bcrypt [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80451) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 06:02:59.611889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abc529-96ec-418c-853a-715132ea2d01 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:59.635375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:02:59.646065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:02:59.647645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:02:59.715547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6abc529-96ec-418c-853a-715132ea2d01 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:02:59.750977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:02:59.756173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:02:59.756173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:59.756173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:59.756173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:59.768007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:02:59.773693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:02:59.779282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:02:59.780685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:02:59.782037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 7/14] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:02:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:02:59.786224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:59.869435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:02:59.880402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0be451-ed1f-4a61-81f0-13e57b52f58c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:02:59.883425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:02:59.887592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279c7a18-6de4-4c21-974c-242720706b92 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:02:59.918112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:02:59.919051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:59.919344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:59.919626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:59.923046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:02:59.923708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:02:59.923988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:02:59.924263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:02:59.925039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:02:59.925346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:02:59.926752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:02:59.940287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 8/15] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:02:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:02:59.946102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:02:59.992263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:02:59.993830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:00.052700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84b316-9cf2-46c6-b831-50a07b523d9f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:00.087145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:00.088095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:00.089450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:00.089450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] PATH_INFO: `/v3/users/20e59e7d825648b8a25362d3fc9a5d44` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:00.091157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] RBAC: Authorizing `identity:get_user(user_id=20e59e7d825648b8a25362d3fc9a5d44)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:00.091837 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:00.093840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 9/16] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:02:59 2022] GET /identity/v3/users/20e59e7d825648b8a25362d3fc9a5d44 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:00.099214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:00.101070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 8/17] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:03:00.106310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:00.109944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:00.115881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:00.204040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386a9f-3e61-4d9d-b853-421e16f23eff None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:00.206771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c4ea6-151b-4278-92b2-3bcc2f6607a0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:00.241775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:00.242573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:00.242856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:00.243132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:00.254194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:00.255688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:00.256201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:00.256699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:00.258823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:00.261628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:00.261730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:00.263085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:00.264628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 10/18] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:00.270712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:03:00.288137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:00.289073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:00.289867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:03:00.289867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:03:00.289867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:03:00.289867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:00.289867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 9/19] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:00.295158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:00.355644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:00.362542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:00.383651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739332c-c90e-4ec7-bd36-fc6cf476471d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:00.402218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe986cf9-e5cc-4b1a-9e88-b2c6033b9d19 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:00.417317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be11ab2-bb8e-4393-be56-9a5fc5a877c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:00.418074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11ab2-bb8e-4393-be56-9a5fc5a877c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:00.418358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11ab2-bb8e-4393-be56-9a5fc5a877c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:00.418636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be11ab2-bb8e-4393-be56-9a5fc5a877c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:00.419470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be11ab2-bb8e-4393-be56-9a5fc5a877c2 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.domain.id=default, user.id=20e59e7d825648b8a25362d3fc9a5d44) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:00.419782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be11ab2-bb8e-4393-be56-9a5fc5a877c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:00.421316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be11ab2-bb8e-4393-be56-9a5fc5a877c2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:00.428497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 11/20] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Jul 18 06:03:00 2022] GET /identity/v3/role_assignments?user.id=20e59e7d825648b8a25362d3fc9a5d44&scope.domain.id=default&role.id=a30b539353cf42d08ab504edac924aa8 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:00.438084 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a26e6c-3510-4de9-99a8-7d2407187376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:00.438769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26e6c-3510-4de9-99a8-7d2407187376 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:00.439055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26e6c-3510-4de9-99a8-7d2407187376 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:00.439331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a26e6c-3510-4de9-99a8-7d2407187376 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:00.440077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26e6c-3510-4de9-99a8-7d2407187376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:00.440385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26e6c-3510-4de9-99a8-7d2407187376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:00.441881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a26e6c-3510-4de9-99a8-7d2407187376 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:00.462706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 10/21] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:02.608628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e75ca9-3f0e-4fb6-a57c-0fccbcf135f8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:02.609654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e75ca9-3f0e-4fb6-a57c-0fccbcf135f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:02.610144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e75ca9-3f0e-4fb6-a57c-0fccbcf135f8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:02.612120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 12/22] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:02.618102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed2d7-4eed-4c4d-b6bb-629c1e398ed2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:02.619051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed2d7-4eed-4c4d-b6bb-629c1e398ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:02.619527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ed2d7-4eed-4c4d-b6bb-629c1e398ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:02.650125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7f6ed2d7-4eed-4c4d-b6bb-629c1e398ed2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:02.651713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7f6ed2d7-4eed-4c4d-b6bb-629c1e398ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:02.759079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 11/23] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:02.801054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e75ca9-3f0e-4fb6-a57c-0fccbcf135f8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:02.842082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d89c08-c0f0-4462-9058-006875b84ca1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:02.842775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d89c08-c0f0-4462-9058-006875b84ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:02.843276 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d89c08-c0f0-4462-9058-006875b84ca1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:02.844917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 12/24] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:02.868755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0957c-0887-4ff8-86ba-f6d6b3129642 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:02.869367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0957c-0887-4ff8-86ba-f6d6b3129642 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:02.869838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0957c-0887-4ff8-86ba-f6d6b3129642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:02.910857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-eef0957c-0887-4ff8-86ba-f6d6b3129642 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:02.912424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-eef0957c-0887-4ff8-86ba-f6d6b3129642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:02.981707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e75ca9-3f0e-4fb6-a57c-0fccbcf135f8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:03.037148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:03.054638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:03.056027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.056323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.056605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.080851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:03.089680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:03.090544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:03.091274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 13/25] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:03.099332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:03.111555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:03.126013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:03.184603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0957c-0887-4ff8-86ba-f6d6b3129642 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:03.291419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a028e-8c0c-4e70-af6c-c64b1d0c8348 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:03.394458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404a8fd-0b1b-490f-b74f-a692a23b8d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:03.395149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404a8fd-0b1b-490f-b74f-a692a23b8d39 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.395688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404a8fd-0b1b-490f-b74f-a692a23b8d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.396107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404a8fd-0b1b-490f-b74f-a692a23b8d39 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.397033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404a8fd-0b1b-490f-b74f-a692a23b8d39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:03.397497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404a8fd-0b1b-490f-b74f-a692a23b8d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:03.399050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404a8fd-0b1b-490f-b74f-a692a23b8d39 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:03.416372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 14/27] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:03.419638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab16f2-f7d2-4e4d-841b-9213890cb3a4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.420136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab16f2-f7d2-4e4d-841b-9213890cb3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.420641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab16f2-f7d2-4e4d-841b-9213890cb3a4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.422651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 15/28] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:03.426005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab16f2-f7d2-4e4d-841b-9213890cb3a4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:03.434541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0957c-0887-4ff8-86ba-f6d6b3129642 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:03.517822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5272c2-435c-4a05-8a88-18d29abcd98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:03.518656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5272c2-435c-4a05-8a88-18d29abcd98c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.518946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5272c2-435c-4a05-8a88-18d29abcd98c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.519227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5272c2-435c-4a05-8a88-18d29abcd98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.540491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5272c2-435c-4a05-8a88-18d29abcd98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:03.542037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5272c2-435c-4a05-8a88-18d29abcd98c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-df5272c2-435c-4a05-8a88-18d29abcd98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:03:03.573812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:03.574670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:03.575442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:03:03.575442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:03:03.575442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:03:03.575442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:03.577382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:03.584360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 14/29] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:03.584360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33471d1-25a8-4b4c-96c1-86e965c1ce45 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.584360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33471d1-25a8-4b4c-96c1-86e965c1ce45 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.584360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33471d1-25a8-4b4c-96c1-86e965c1ce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.607242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c33471d1-25a8-4b4c-96c1-86e965c1ce45 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:03.610095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c33471d1-25a8-4b4c-96c1-86e965c1ce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:03.625005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab16f2-f7d2-4e4d-841b-9213890cb3a4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:03.656486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:03.673476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e0aa6-db96-40dd-b5a0-c077147c666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:03.674639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0aa6-db96-40dd-b5a0-c077147c666f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.675083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0aa6-db96-40dd-b5a0-c077147c666f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.675506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e0aa6-db96-40dd-b5a0-c077147c666f None admin] PATH_INFO: `/v3/users/20e59e7d825648b8a25362d3fc9a5d44` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.676899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e0aa6-db96-40dd-b5a0-c077147c666f None admin] RBAC: Authorizing `identity:get_user(user_id=20e59e7d825648b8a25362d3fc9a5d44)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:03.679085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e0aa6-db96-40dd-b5a0-c077147c666f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:03.681936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 16/30] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:03 2022] GET /identity/v3/users/20e59e7d825648b8a25362d3fc9a5d44 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:03.683721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5235-af75-4624-8e94-950e80e8abc6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.684222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5235-af75-4624-8e94-950e80e8abc6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.684661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116a5235-af75-4624-8e94-950e80e8abc6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.686685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 17/31] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:03.687658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5235-af75-4624-8e94-950e80e8abc6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:03.726140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 15/32] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:03.727559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33471d1-25a8-4b4c-96c1-86e965c1ce45 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:03.823589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116a5235-af75-4624-8e94-950e80e8abc6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:03.840429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33471d1-25a8-4b4c-96c1-86e965c1ce45 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:03.863445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:03.864356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.864784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.865326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.866263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:03.866739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:03.868336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:03.870793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:03.882806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd7505-1e87-4b99-bdb5-bb28ee3fb6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:03.883990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7505-1e87-4b99-bdb5-bb28ee3fb6cd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.884388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7505-1e87-4b99-bdb5-bb28ee3fb6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.884781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd7505-1e87-4b99-bdb5-bb28ee3fb6cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.886465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7505-1e87-4b99-bdb5-bb28ee3fb6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:03.888068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dd7505-1e87-4b99-bdb5-bb28ee3fb6cd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:03.890785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 16/33] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:03.892387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327327c-f5f6-4d93-868c-95a84e9648cd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:03.892779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327327c-f5f6-4d93-868c-95a84e9648cd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:03.893204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327327c-f5f6-4d93-868c-95a84e9648cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:03.894323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 18/34] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:03.895296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:03.919297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b327327c-f5f6-4d93-868c-95a84e9648cd None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:03.920615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b327327c-f5f6-4d93-868c-95a84e9648cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:03.945243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:04.002207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 17/35] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:04.003310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327327c-f5f6-4d93-868c-95a84e9648cd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:04.015096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ff168-748f-4419-bdb1-36b36fd94815 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:04.055841 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:04.056873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.057411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.057980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.058980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:04.060710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:04.125484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327327c-f5f6-4d93-868c-95a84e9648cd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:04.174904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:04.176421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.176935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.177472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] PATH_INFO: `/v3/domains/default/users/20e59e7d825648b8a25362d3fc9a5d44/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.180547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=20e59e7d825648b8a25362d3fc9a5d44, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:04.182545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:04.276237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 19/36] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 18 06:03:03 2022] POST /identity/v3/roles => generated 225 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:04.277026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:04.419167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:04.479309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cdf2f2-482a-4373-aa16-d58098729236 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:04.492712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 18/37] 10.222.0.27 () {58 vars in 1361 bytes} [Mon Jul 18 06:03:04 2022] PUT /identity/v3/domains/default/users/20e59e7d825648b8a25362d3fc9a5d44/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:04.494006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:04.519660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:04.535032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1138ef-e943-45bc-836e-c9e97b03a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:04.535982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1138ef-e943-45bc-836e-c9e97b03a560 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.536283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1138ef-e943-45bc-836e-c9e97b03a560 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.536569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1138ef-e943-45bc-836e-c9e97b03a560 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.538778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1138ef-e943-45bc-836e-c9e97b03a560 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:04.539078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1138ef-e943-45bc-836e-c9e97b03a560 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:04.630507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a6063-0a4f-4064-ac48-da19837d9383 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:04.673533 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687104a4-d937-4aa0-b0bc-c1d64b35618e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:04.674237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687104a4-d937-4aa0-b0bc-c1d64b35618e None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.674532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687104a4-d937-4aa0-b0bc-c1d64b35618e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.674821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687104a4-d937-4aa0-b0bc-c1d64b35618e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.675402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 20/38] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:03:04 2022] POST /identity/v3/projects => generated 301 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:04.675787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687104a4-d937-4aa0-b0bc-c1d64b35618e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:04.677080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4af4-a31b-44fb-a94b-487d83a39c74 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.677292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4af4-a31b-44fb-a94b-487d83a39c74 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.677562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687104a4-d937-4aa0-b0bc-c1d64b35618e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:04.677660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f4af4-a31b-44fb-a94b-487d83a39c74 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.679406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 21/39] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:04.680823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90637125-e1e4-4711-b2e5-e22aaf0fa551 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.681171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90637125-e1e4-4711-b2e5-e22aaf0fa551 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.681435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90637125-e1e4-4711-b2e5-e22aaf0fa551 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.683390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 22/40] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:04.689782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389ced-e9ff-431a-aa0d-6beaf7354535 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.690078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389ced-e9ff-431a-aa0d-6beaf7354535 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.690368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b389ced-e9ff-431a-aa0d-6beaf7354535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.712362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1b389ced-e9ff-431a-aa0d-6beaf7354535 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:04.714043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1b389ced-e9ff-431a-aa0d-6beaf7354535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:04.769620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 19/41] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 18 06:03:04 2022] POST /identity/v3/roles => generated 219 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:04.771815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390cf22-ff28-4a00-a0b3-4b2be97c39d3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:04.772461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390cf22-ff28-4a00-a0b3-4b2be97c39d3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:04.772996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4390cf22-ff28-4a00-a0b3-4b2be97c39d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:04.795200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4390cf22-ff28-4a00-a0b3-4b2be97c39d3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:04.798399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4390cf22-ff28-4a00-a0b3-4b2be97c39d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:04.890430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 20/42] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:04.928470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390cf22-ff28-4a00-a0b3-4b2be97c39d3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:04.938334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:04.944154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 23/43] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:04.970070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b389ced-e9ff-431a-aa0d-6beaf7354535 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:05.024079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:05.082913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4390cf22-ff28-4a00-a0b3-4b2be97c39d3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:05.128315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b389ced-e9ff-431a-aa0d-6beaf7354535 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:05.129346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852cb55b-bfb1-44ed-956e-23a3a465b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:05.132776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb55b-bfb1-44ed-956e-23a3a465b814 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:05.132776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb55b-bfb1-44ed-956e-23a3a465b814 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:05.132776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852cb55b-bfb1-44ed-956e-23a3a465b814 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:05.132776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cb55b-bfb1-44ed-956e-23a3a465b814 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:05.132776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852cb55b-bfb1-44ed-956e-23a3a465b814 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:05.169743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:05.171068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:05.171448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:05.171730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:05.172911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:05.174469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:05.176105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 24/44] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:05.181815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:05.214964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 21/45] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 18 06:03:04 2022] POST /identity/v3/roles => generated 223 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:03:05.307004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00a387-60ba-465e-865a-8f6d5b991349 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:05.311643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:05.347928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52141db-9088-495d-a09e-6bac19dafe59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:05.348618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52141db-9088-495d-a09e-6bac19dafe59 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:05.348910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52141db-9088-495d-a09e-6bac19dafe59 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:05.349249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52141db-9088-495d-a09e-6bac19dafe59 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:05.350042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52141db-9088-495d-a09e-6bac19dafe59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:05.352274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52141db-9088-495d-a09e-6bac19dafe59 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:05.433045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 25/46] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:03:05 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:03:06.670822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017718-3316-4209-a5ce-3a74bdf12b46 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:06.671396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017718-3316-4209-a5ce-3a74bdf12b46 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:06.671633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017718-3316-4209-a5ce-3a74bdf12b46 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:06.673196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 22/47] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:06.678256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f82b5-851a-4ae9-86c1-6075ed301927 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:06.678896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f82b5-851a-4ae9-86c1-6075ed301927 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:06.679087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f82b5-851a-4ae9-86c1-6075ed301927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:06.696003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4c9f82b5-851a-4ae9-86c1-6075ed301927 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:06.697253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4c9f82b5-851a-4ae9-86c1-6075ed301927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:06.767000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 26/48] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:06.790444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017718-3316-4209-a5ce-3a74bdf12b46 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:06.859780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:06.896679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017718-3316-4209-a5ce-3a74bdf12b46 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:06.931147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:06.931866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:06.932151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:06.932434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:06.945058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:06.954675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:06.955665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:06.956413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 23/49] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:06.961879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f82b5-851a-4ae9-86c1-6075ed301927 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:07.049225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:07.064594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f82b5-851a-4ae9-86c1-6075ed301927 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:07.100460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:07.101252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.101611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.101900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.102660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:07.102968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:07.104372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:07.113300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 27/50] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:07.118949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:07.220029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7c6f-41d8-4174-a629-d5649ed2b17f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:07.244862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:07.254119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:07.256009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.256009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.256009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] PATH_INFO: `/v3/users/20e59e7d825648b8a25362d3fc9a5d44` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.257107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] RBAC: Authorizing `identity:get_user(user_id=20e59e7d825648b8a25362d3fc9a5d44)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:07.258564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:07.260190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 24/51] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:07 2022] GET /identity/v3/users/20e59e7d825648b8a25362d3fc9a5d44 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:07.265896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:07.371943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784cc5e-244b-49ee-b322-1bcc1ac8968e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:07.406365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8375ff-527d-40b8-b036-bfe8c92165fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:07.407153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8375ff-527d-40b8-b036-bfe8c92165fa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.407436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8375ff-527d-40b8-b036-bfe8c92165fa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.407712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8375ff-527d-40b8-b036-bfe8c92165fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.408891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8375ff-527d-40b8-b036-bfe8c92165fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:07.410375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8375ff-527d-40b8-b036-bfe8c92165fa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:07.411997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 28/52] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:07.417850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:07.486261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4fef5-fa03-4757-a2be-f1f57322ac9b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.486567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4fef5-fa03-4757-a2be-f1f57322ac9b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.486858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4fef5-fa03-4757-a2be-f1f57322ac9b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.488273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 29/53] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:07.493319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5223-e452-4b55-bd36-f492445d1032 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.493621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5223-e452-4b55-bd36-f492445d1032 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.493909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a5223-e452-4b55-bd36-f492445d1032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.510329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e58a5223-e452-4b55-bd36-f492445d1032 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:07.511546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e58a5223-e452-4b55-bd36-f492445d1032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:07.521236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a254d-ba70-45b9-91ad-480b4ecfcc1a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:07.523180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:07.556275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:07.556938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.557257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.557537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.558379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.domain.id=default, user.id=20e59e7d825648b8a25362d3fc9a5d44) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:07.558686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:07.560146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:07.568589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 25/54] 10.222.0.27 () {56 vars in 1322 bytes} [Mon Jul 18 06:03:07 2022] GET /identity/v3/role_assignments?user.id=20e59e7d825648b8a25362d3fc9a5d44&scope.domain.id=default&role.id=a30b539353cf42d08ab504edac924aa8 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:07.582128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 30/55] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:07.606030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:07.777980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:07.822575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26987d-a1b0-4e7f-b227-b1845325bb40 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:07.856168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b27a72-52c2-4e04-90f0-5f7c00a574cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:07.856968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b27a72-52c2-4e04-90f0-5f7c00a574cc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.857284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b27a72-52c2-4e04-90f0-5f7c00a574cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.857567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b27a72-52c2-4e04-90f0-5f7c00a574cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.859473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b27a72-52c2-4e04-90f0-5f7c00a574cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:07.860926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b27a72-52c2-4e04-90f0-5f7c00a574cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:07.862610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 26/56] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:07.868332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a5223-e452-4b55-bd36-f492445d1032 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:07.964128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a5223-e452-4b55-bd36-f492445d1032 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:07.997127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22c0af-cb3a-4315-b086-bea4c73473c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:07.997787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c0af-cb3a-4315-b086-bea4c73473c7 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:07.998072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c0af-cb3a-4315-b086-bea4c73473c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:07.998403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22c0af-cb3a-4315-b086-bea4c73473c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:07.999386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22c0af-cb3a-4315-b086-bea4c73473c7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:08.000831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc22c0af-cb3a-4315-b086-bea4c73473c7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:08.095032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:08.101632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 31/57] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Jul 18 06:03:07 2022] POST /identity/v3/projects => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:10.138604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf97d4-4bcc-4f89-a8b8-3230928f8506 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:10.139733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf97d4-4bcc-4f89-a8b8-3230928f8506 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:10.139883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf97d4-4bcc-4f89-a8b8-3230928f8506 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:10.141833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 27/58] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:10.147363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaec09b-7f94-4a6e-b069-8436abeed162 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:10.147771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaec09b-7f94-4a6e-b069-8436abeed162 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:10.147918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaec09b-7f94-4a6e-b069-8436abeed162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:10.165646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bbaec09b-7f94-4a6e-b069-8436abeed162 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:10.166856 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bbaec09b-7f94-4a6e-b069-8436abeed162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:10.233267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 32/59] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:10.257412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf97d4-4bcc-4f89-a8b8-3230928f8506 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:10.361425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf97d4-4bcc-4f89-a8b8-3230928f8506 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:10.386939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:10.395578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a791ed-0a3a-40be-ad72-ed56f8271d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:10.396381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a791ed-0a3a-40be-ad72-ed56f8271d92 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:10.396675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a791ed-0a3a-40be-ad72-ed56f8271d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:10.396958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a791ed-0a3a-40be-ad72-ed56f8271d92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:10.398189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a791ed-0a3a-40be-ad72-ed56f8271d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:10.399651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a791ed-0a3a-40be-ad72-ed56f8271d92 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:10.401354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 28/60] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:10.406997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaec09b-7f94-4a6e-b069-8436abeed162 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:10.505705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaec09b-7f94-4a6e-b069-8436abeed162 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:10.532378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:10.539988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e85627-72d1-4053-b149-1b7d6e6f87b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:10.540662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e85627-72d1-4053-b149-1b7d6e6f87b9 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:10.541157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e85627-72d1-4053-b149-1b7d6e6f87b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:10.541305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e85627-72d1-4053-b149-1b7d6e6f87b9 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:10.542030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e85627-72d1-4053-b149-1b7d6e6f87b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:10.543474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e85627-72d1-4053-b149-1b7d6e6f87b9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:10.635198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 33/61] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:03:10 2022] POST /identity/v3/users => generated 275 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:13.744147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90222-9f75-4bbd-9f86-0b6a25b1e32b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:13.745119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90222-9f75-4bbd-9f86-0b6a25b1e32b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:13.745549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90222-9f75-4bbd-9f86-0b6a25b1e32b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:13.747212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 29/62] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:13.755717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588196-b2c1-4b7e-acae-7ba07ff76e04 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:13.756604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588196-b2c1-4b7e-acae-7ba07ff76e04 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:13.757154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588196-b2c1-4b7e-acae-7ba07ff76e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:13.786258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1f588196-b2c1-4b7e-acae-7ba07ff76e04 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:13.787749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1f588196-b2c1-4b7e-acae-7ba07ff76e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:13.883463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 34/63] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:13.930153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90222-9f75-4bbd-9f86-0b6a25b1e32b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:14.063721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90222-9f75-4bbd-9f86-0b6a25b1e32b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:14.102899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc85a456-e225-416e-b2e5-addb35411681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:14.103962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85a456-e225-416e-b2e5-addb35411681 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.104393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85a456-e225-416e-b2e5-addb35411681 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.104814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc85a456-e225-416e-b2e5-addb35411681 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.129319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc85a456-e225-416e-b2e5-addb35411681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cc85a456-e225-416e-b2e5-addb35411681 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:14.145601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:14.147537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:14.149310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:14.153203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 30/64] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:14.162322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588196-b2c1-4b7e-acae-7ba07ff76e04 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:14.241717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415428a-6b26-4c59-a49f-5c88e824233a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.242374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415428a-6b26-4c59-a49f-5c88e824233a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.242879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415428a-6b26-4c59-a49f-5c88e824233a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.244580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 31/65] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:14.250920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c206bb-3884-497e-892a-8fd76b8cf470 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.251528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c206bb-3884-497e-892a-8fd76b8cf470 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.252004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c206bb-3884-497e-892a-8fd76b8cf470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.272640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e6c206bb-3884-497e-892a-8fd76b8cf470 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:14.274299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e6c206bb-3884-497e-892a-8fd76b8cf470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:14.298252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588196-b2c1-4b7e-acae-7ba07ff76e04 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:14.316752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:14.341167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:14.342625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb821e9-67d3-4a62-8bc6-95616f2056a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:14.343597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb821e9-67d3-4a62-8bc6-95616f2056a7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.344026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb821e9-67d3-4a62-8bc6-95616f2056a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.344446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb821e9-67d3-4a62-8bc6-95616f2056a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.345422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb821e9-67d3-4a62-8bc6-95616f2056a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:14.345909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb821e9-67d3-4a62-8bc6-95616f2056a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:14.347519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb821e9-67d3-4a62-8bc6-95616f2056a7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:14.358726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 35/66] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:14.360484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279efd6-a259-4a7b-b9c5-8b80d8e6ae4b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.360958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279efd6-a259-4a7b-b9c5-8b80d8e6ae4b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.361492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279efd6-a259-4a7b-b9c5-8b80d8e6ae4b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.363437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 36/67] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:14.364835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 32/68] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:14.368967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279efd6-a259-4a7b-b9c5-8b80d8e6ae4b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:14.370596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740da5b-0fef-4233-8348-5019d1f61cf2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.371682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740da5b-0fef-4233-8348-5019d1f61cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.371682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2740da5b-0fef-4233-8348-5019d1f61cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.404697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2740da5b-0fef-4233-8348-5019d1f61cf2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:14.406394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2740da5b-0fef-4233-8348-5019d1f61cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:14.518450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 33/69] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:14.526876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740da5b-0fef-4233-8348-5019d1f61cf2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:14.537804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279efd6-a259-4a7b-b9c5-8b80d8e6ae4b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:14.593160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:14.594378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.594725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.595076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.612656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:14.614905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:14.616486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 37/70] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:14 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:14.624669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:14.657224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:14.735778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2740da5b-0fef-4233-8348-5019d1f61cf2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:14.736114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2a6e2e-b838-4a05-9b7d-5bdd51788146 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:14.762424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:14.778735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:14.779748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.780042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.780330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.793106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:14.800700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b805dc8-c3e2-41aa-b97a-a45ddda83e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:14.802140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805dc8-c3e2-41aa-b97a-a45ddda83e53 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:14.802250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:14.803077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:14.804089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:14.804658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805dc8-c3e2-41aa-b97a-a45ddda83e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.804658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b805dc8-c3e2-41aa-b97a-a45ddda83e53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.804790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 38/71] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:14.804790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:14.824014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b805dc8-c3e2-41aa-b97a-a45ddda83e53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5b805dc8-c3e2-41aa-b97a-a45ddda83e53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:14.838750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:14.839661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:14.840388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:14.841584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 34/72] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:14.843815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b7824-0987-457a-b52d-8523f46f8ebb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.844234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b7824-0987-457a-b52d-8523f46f8ebb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.844685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b7824-0987-457a-b52d-8523f46f8ebb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.850910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 35/73] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:14.850910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc545-2c0c-474a-a912-0990adce1ab9 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.850910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc545-2c0c-474a-a912-0990adce1ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.850910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835fc545-2c0c-474a-a912-0990adce1ab9 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.852699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 36/74] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:14.854179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc545-2c0c-474a-a912-0990adce1ab9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:14.914049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:14.921597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704a29b-9040-4d84-83d4-23b937ea799c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:14.962573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e43d7d-87b7-4d72-9d08-551b4d9bee53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:14.963270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43d7d-87b7-4d72-9d08-551b4d9bee53 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:14.963567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43d7d-87b7-4d72-9d08-551b4d9bee53 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:14.963851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e43d7d-87b7-4d72-9d08-551b4d9bee53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:14.980208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835fc545-2c0c-474a-a912-0990adce1ab9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.019073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.019925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.020326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.020759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.021768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:15.022203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.023886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.045022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:15.045805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e43d7d-87b7-4d72-9d08-551b4d9bee53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.045908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.045991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e43d7d-87b7-4d72-9d08-551b4d9bee53 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.084971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.147722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.157405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 39/76] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:15.159254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a02a3-b3bb-45d5-8c96-70c50cb066f2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.159633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a02a3-b3bb-45d5-8c96-70c50cb066f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.160111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a02a3-b3bb-45d5-8c96-70c50cb066f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.164287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b013a-f1fa-4d06-b566-453aa957f61a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.179882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-973a02a3-b3bb-45d5-8c96-70c50cb066f2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:15.181748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-973a02a3-b3bb-45d5-8c96-70c50cb066f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:15.205337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a7c86-525a-4afd-9bab-f7e1f1bf3f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.206032 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a7c86-525a-4afd-9bab-f7e1f1bf3f5a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.206327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a7c86-525a-4afd-9bab-f7e1f1bf3f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.206623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a7c86-525a-4afd-9bab-f7e1f1bf3f5a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.207411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a7c86-525a-4afd-9bab-f7e1f1bf3f5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:15.207730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a7c86-525a-4afd-9bab-f7e1f1bf3f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.209202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a7c86-525a-4afd-9bab-f7e1f1bf3f5a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.218961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 38/77] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:15.221235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e5959-45ee-4f0e-8beb-9a32e755ec98 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.221737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e5959-45ee-4f0e-8beb-9a32e755ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.222229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e5959-45ee-4f0e-8beb-9a32e755ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.242683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2b8e5959-45ee-4f0e-8beb-9a32e755ec98 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:15.243922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b8e5959-45ee-4f0e-8beb-9a32e755ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:15.265332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 40/78] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:15.266615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a02a3-b3bb-45d5-8c96-70c50cb066f2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.333848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 39/79] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:15.334736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e5959-45ee-4f0e-8beb-9a32e755ec98 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.365991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.391239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a02a3-b3bb-45d5-8c96-70c50cb066f2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.417161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.430587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.431478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.431760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.432220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.433361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.434868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.437487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 41/80] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:15.438362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.462895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e5959-45ee-4f0e-8beb-9a32e755ec98 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.504395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.505336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.505623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.505906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.507224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.508748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.510650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 40/81] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:15.511547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.558499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef297162-7fb5-4810-9e43-129091d703f6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.596159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.597077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.597366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.597651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] PATH_INFO: `/v3/users/20e59e7d825648b8a25362d3fc9a5d44` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.598966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] RBAC: Authorizing `identity:get_user(user_id=20e59e7d825648b8a25362d3fc9a5d44)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.600434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.602198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 42/82] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/users/20e59e7d825648b8a25362d3fc9a5d44 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:15.602999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.619943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.627926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4394c-b112-4374-8667-dfbf8f76e8ce None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.667068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.667939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.668179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.668460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.669750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.671272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.672521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.677831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 41/83] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:15.677831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.731265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be9622-fc53-44cc-bbcf-047bc3e999b0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.774135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.774965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.775253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.775529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.789420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:15.791312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b81a5c-ed5a-473f-9779-316468ea8ffc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:15.797812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:15.799401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 43/84] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:15.801621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:15.837723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.838415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.838737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.839086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.875412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.916286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e631ee-24c7-4abb-94bc-6c366d6d6d59 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:15.920134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.921685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.939773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:15.954663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:15.955366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:15.955654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:15.955939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:15.956800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=820e7098b5fc456da790361acd082164) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:15.957150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:15.958652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:15.964753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 44/85] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/role_assignments?user.id=820e7098b5fc456da790361acd082164&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=82e9eb17bbd04cf888953955a1c648af => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:15.965641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:16.057041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 42/86] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:16.057041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:16.115630 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719e0ac3-024e-4882-a7ff-80cac43a9ea1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:16.144651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:16.164325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:16.165043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:16.165757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:16.165757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:16.214372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f598bb-3567-4790-a7db-763b48b5af6c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:16.257120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:16.276758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:16.278073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:16.278381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:16.278810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:16.280439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:16.280877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:16.282318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:16.282607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:16.406385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 45/87] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:16.408393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:16.409516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 43/88] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:03:16 2022] POST /identity/v3/users => generated 289 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:16.410524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:16.586462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d150b9-4985-49b1-a0f3-e5692a57eaf0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:16.613381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:16.614358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:16.632300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff1451-c6d0-46e0-a905-bd771873e14e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:16.633149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:16.634284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:16.634788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:16.635300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:16.636921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:16.638724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:16.641219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 44/89] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:16 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:16.642352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:16.699443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:16.700510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:16.701015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:16.701551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:16.703242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:16.703770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:16.706702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:16.720503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 46/90] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:16.721290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:16.842680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26b167-173d-4e01-9489-a13bdc6bd274 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:16.910190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:16.911982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:16.912712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:16.913471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:16.916465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:16.920674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:16.924813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 45/91] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:16 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:16.925424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:16.955956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1e852-2f72-479c-acb8-2078a2286adc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:17.015760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:17.016042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:17.016167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:17.016511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:17.018778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] RBAC: Adding query filter params (role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=820e7098b5fc456da790361acd082164) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:17.019106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:17.020659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:17.027745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 47/92] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:16 2022] GET /identity/v3/role_assignments?user.id=820e7098b5fc456da790361acd082164&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=e5e16600844f49db892c00085568f6e8 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:17.034080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:17.052900 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:17.066105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:17.178579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a4aa2-e328-4cac-91e5-5a4dacf0d002 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:17.302664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:17.304767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:17.305686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:17.306405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:17.313073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:17.316073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:17.320129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 46/93] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:16 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:17.330326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:17.387472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3224a654-4514-4a38-889d-ec6c1535a081 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:17.472579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:17.473810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:17.474121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:17.474611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:17.476189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=20e59e7d825648b8a25362d3fc9a5d44) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:17.476758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:17.479629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:17.501667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 48/94] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:17 2022] GET /identity/v3/role_assignments?user.id=20e59e7d825648b8a25362d3fc9a5d44&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:17.565169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf1166-5371-4713-b97f-763e78fe7dcf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:17.605516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:17.619541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:17.620255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:17.620549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:17.620836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:17.722256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:17.723914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:17.879564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 47/95] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:03:17.885642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:18.054838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:18.121388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b86db-af89-4f2b-9ab0-fca6b73428bf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:18.194464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f507c-fdd8-47c8-99ab-e0fd4a837e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:18.195816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f507c-fdd8-47c8-99ab-e0fd4a837e8a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:18.196248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f507c-fdd8-47c8-99ab-e0fd4a837e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:18.196680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f507c-fdd8-47c8-99ab-e0fd4a837e8a None admin] PATH_INFO: `/v3/projects/606bbf88a1864cafad805264b9f81fa0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:18.198605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f507c-fdd8-47c8-99ab-e0fd4a837e8a None admin] RBAC: Authorizing `identity:get_project(project_id=606bbf88a1864cafad805264b9f81fa0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:18.200993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f507c-fdd8-47c8-99ab-e0fd4a837e8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:18.205296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 49/96] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:17 2022] GET /identity/v3/projects/606bbf88a1864cafad805264b9f81fa0 => generated 312 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:18.211367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:18.261398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:18.404314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a15d2d-3c4c-4be6-8729-88fd2347d2af None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:18.460470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3aa263-c942-4854-baa5-9e80662517cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:18.461201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aa263-c942-4854-baa5-9e80662517cf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:18.461498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aa263-c942-4854-baa5-9e80662517cf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:18.461788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3aa263-c942-4854-baa5-9e80662517cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:18.462662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3aa263-c942-4854-baa5-9e80662517cf None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=606bbf88a1864cafad805264b9f81fa0, user.id=820e7098b5fc456da790361acd082164) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:18.462993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3aa263-c942-4854-baa5-9e80662517cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:18.464518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3aa263-c942-4854-baa5-9e80662517cf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:18.473861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 48/97] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:18 2022] GET /identity/v3/role_assignments?user.id=820e7098b5fc456da790361acd082164&scope.project.id=606bbf88a1864cafad805264b9f81fa0&role.id=82e9eb17bbd04cf888953955a1c648af => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:18.797971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce51ce-0df6-475f-a3d1-f4479c47e9fc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:18.798688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce51ce-0df6-475f-a3d1-f4479c47e9fc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:18.799177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce51ce-0df6-475f-a3d1-f4479c47e9fc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:18.800839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 50/98] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:18.807328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d379511-7fca-4049-82cf-df543b3fd33b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:18.807986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d379511-7fca-4049-82cf-df543b3fd33b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:18.808476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d379511-7fca-4049-82cf-df543b3fd33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:18.828690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6d379511-7fca-4049-82cf-df543b3fd33b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:18.830329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6d379511-7fca-4049-82cf-df543b3fd33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:18.948074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 49/99] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:18.999122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce51ce-0df6-475f-a3d1-f4479c47e9fc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:19.145385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce51ce-0df6-475f-a3d1-f4479c47e9fc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:19.222622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479331d0-66da-44c9-8039-109e6439892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:19.223987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479331d0-66da-44c9-8039-109e6439892c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:19.224506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479331d0-66da-44c9-8039-109e6439892c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:19.225026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479331d0-66da-44c9-8039-109e6439892c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:19.249671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479331d0-66da-44c9-8039-109e6439892c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-479331d0-66da-44c9-8039-109e6439892c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:19.265912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:19.266816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:19.267558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:19.268684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 51/100] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:19.274185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d379511-7fca-4049-82cf-df543b3fd33b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:19.326225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:19.453467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d379511-7fca-4049-82cf-df543b3fd33b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:19.501421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:19.502450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:19.502875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:19.503292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:19.504194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:19.504639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:19.506202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:19.518254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 50/101] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:19.524475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479331d0-66da-44c9-8039-109e6439892c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:19.537380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:19.747067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479331d0-66da-44c9-8039-109e6439892c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:19.817787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:19.819851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:19.820664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:19.821483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:19.824089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:19.827905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:19.831437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 52/102] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:19 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:19.837264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:19.991452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:20.018767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957a79f-ba56-4cb0-b3d5-32dd148d45eb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:20.070966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106c203-2563-4414-a3d8-623a9b1afbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:20.071876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106c203-2563-4414-a3d8-623a9b1afbf5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:20.072167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106c203-2563-4414-a3d8-623a9b1afbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:20.072453 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106c203-2563-4414-a3d8-623a9b1afbf5 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:20.073736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106c203-2563-4414-a3d8-623a9b1afbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:20.075218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106c203-2563-4414-a3d8-623a9b1afbf5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:20.078141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 51/103] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:19 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:20.084605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:20.126919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd672a7-92ff-47ad-9a06-b366259a7350 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:20.127573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd672a7-92ff-47ad-9a06-b366259a7350 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:20.128087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd672a7-92ff-47ad-9a06-b366259a7350 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:20.129905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 52/104] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:20.135771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352f99d-4a9a-44ae-84e0-52e7e0394ab4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:20.136358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352f99d-4a9a-44ae-84e0-52e7e0394ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:20.136875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352f99d-4a9a-44ae-84e0-52e7e0394ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:20.156434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5352f99d-4a9a-44ae-84e0-52e7e0394ab4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:20.158042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5352f99d-4a9a-44ae-84e0-52e7e0394ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:20.273575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:20.283867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 53/105] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:20.321644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352f99d-4a9a-44ae-84e0-52e7e0394ab4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:20.339932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b65085-c0d0-4711-ab71-1aec1b06515c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:20.463640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:20.465265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:20.465797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:20.466307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06/users/820e7098b5fc456da790361acd082164/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:20.471764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] RBAC: Authorizing `identity:create_grant(project_id=45afb887c4d943998202e1bc7943bb06, user_id=820e7098b5fc456da790361acd082164, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:20.474644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:20.555785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:20.598741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 53/106] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:20 2022] PUT /identity/v3/projects/45afb887c4d943998202e1bc7943bb06/users/820e7098b5fc456da790361acd082164/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:20.614272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352f99d-4a9a-44ae-84e0-52e7e0394ab4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:20.715163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e502d2a1-ba71-4f94-95fd-32bc9e22c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:20.716513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d2a1-ba71-4f94-95fd-32bc9e22c74f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:20.717054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d2a1-ba71-4f94-95fd-32bc9e22c74f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:20.717549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e502d2a1-ba71-4f94-95fd-32bc9e22c74f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:20.745621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e502d2a1-ba71-4f94-95fd-32bc9e22c74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e502d2a1-ba71-4f94-95fd-32bc9e22c74f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:20.760692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:20.761737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:20.762531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:20.766953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 54/107] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:20.774611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:20.858774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db710b1b-9a4c-4163-8b53-64efd28c9580 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:20.859130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db710b1b-9a4c-4163-8b53-64efd28c9580 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:20.859581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db710b1b-9a4c-4163-8b53-64efd28c9580 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:20.862367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 55/108] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:20.870360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461fae8-29c0-4ca5-b720-12dcd5b0795f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:20.870846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461fae8-29c0-4ca5-b720-12dcd5b0795f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:20.871327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6461fae8-29c0-4ca5-b720-12dcd5b0795f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:20.922144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6461fae8-29c0-4ca5-b720-12dcd5b0795f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:20.924041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6461fae8-29c0-4ca5-b720-12dcd5b0795f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:21.075370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19d440-d521-4efc-8740-b96d4e987922 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:21.107318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 56/109] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:21.109597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2807bc-d600-425a-8761-6aa6fc4f49f7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.109839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2807bc-d600-425a-8761-6aa6fc4f49f7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.110178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2807bc-d600-425a-8761-6aa6fc4f49f7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.111868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 57/110] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:21.117540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93643ad8-16bf-4645-bb88-c0faca3115d1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.117837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93643ad8-16bf-4645-bb88-c0faca3115d1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.118128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93643ad8-16bf-4645-bb88-c0faca3115d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.149546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-93643ad8-16bf-4645-bb88-c0faca3115d1 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:21.151476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-93643ad8-16bf-4645-bb88-c0faca3115d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:21.165352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:21.187427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:21.188572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.189110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.189622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.191334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:21.191901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:21.194546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:21.227779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:21.230312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 54/111] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:21.234126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:21.240804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 58/112] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:21.242317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93643ad8-16bf-4645-bb88-c0faca3115d1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:21.492998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93643ad8-16bf-4645-bb88-c0faca3115d1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:21.504134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402f0c-b18c-4657-bd19-064a9c519073 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:21.544046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad0b61-7b8e-401b-9d71-83713bd2e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:21.546117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0b61-7b8e-401b-9d71-83713bd2e123 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.546610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0b61-7b8e-401b-9d71-83713bd2e123 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.547105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad0b61-7b8e-401b-9d71-83713bd2e123 None admin] PATH_INFO: `/v3/users/954fb356bbf442c1a471fb24c401eeeb` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.558110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:21.558936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.559225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.559510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.561622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:21.563999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:21.566528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 55/113] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:21.567140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:21.577319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad0b61-7b8e-401b-9d71-83713bd2e123 None admin] RBAC: Authorizing `identity:get_user(user_id=954fb356bbf442c1a471fb24c401eeeb)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:21.579864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad0b61-7b8e-401b-9d71-83713bd2e123 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:21.583106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 59/114] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:21 2022] GET /identity/v3/users/954fb356bbf442c1a471fb24c401eeeb => generated 289 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:21.585281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bedb6-fd57-4ce4-9123-8b4385c944c7 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.585762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bedb6-fd57-4ce4-9123-8b4385c944c7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.586221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bedb6-fd57-4ce4-9123-8b4385c944c7 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.588512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 60/115] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:21.589770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bedb6-fd57-4ce4-9123-8b4385c944c7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:21.661678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:21.699581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:21.716802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5383acb2-b6b4-4381-ae4a-255251e2ccdf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:21.767663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:21.769011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.769517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.770421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.781846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bedb6-fd57-4ce4-9123-8b4385c944c7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:21.789487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:21.799859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:21.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:21.801565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:21.803549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 56/116] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:21.806832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:21.833173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066140a-4d68-4a84-8ba6-473e50ed1e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:21.833928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066140a-4d68-4a84-8ba6-473e50ed1e77 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.834218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066140a-4d68-4a84-8ba6-473e50ed1e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.834552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066140a-4d68-4a84-8ba6-473e50ed1e77 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.835338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066140a-4d68-4a84-8ba6-473e50ed1e77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:21.836835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066140a-4d68-4a84-8ba6-473e50ed1e77 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:21.937671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 61/117] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:03:21 2022] POST /identity/v3/projects => generated 302 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:21.939047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645f7e-f7e5-4f80-86e8-0c9c6a1955a1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:21.939350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645f7e-f7e5-4f80-86e8-0c9c6a1955a1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:21.939637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5645f7e-f7e5-4f80-86e8-0c9c6a1955a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:21.954686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d925e6-0d7b-4528-8151-198685d8447d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:21.960425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e5645f7e-f7e5-4f80-86e8-0c9c6a1955a1 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:21.961724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e5645f7e-f7e5-4f80-86e8-0c9c6a1955a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:21.988756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:22.023053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:22.023735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.023955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.024348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.053175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 62/118] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:22.056883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5645f7e-f7e5-4f80-86e8-0c9c6a1955a1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:22.152312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:22.176533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:22.177921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:22.226601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5645f7e-f7e5-4f80-86e8-0c9c6a1955a1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:22.303126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139fdb2-4224-4e71-9eb4-e22c35204b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:22.305127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fdb2-4224-4e71-9eb4-e22c35204b77 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.306517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 57/119] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:22.307123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fdb2-4224-4e71-9eb4-e22c35204b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.307389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:22.308142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139fdb2-4224-4e71-9eb4-e22c35204b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.309966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139fdb2-4224-4e71-9eb4-e22c35204b77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:22.310841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139fdb2-4224-4e71-9eb4-e22c35204b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:22.314415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139fdb2-4224-4e71-9eb4-e22c35204b77 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:22.332810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 63/120] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:22.340943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:22.341278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697ece-e9fe-485c-8118-9aebb08c2e62 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.341278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697ece-e9fe-485c-8118-9aebb08c2e62 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.341278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697ece-e9fe-485c-8118-9aebb08c2e62 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.341278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 64/121] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:22.341278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a697ece-e9fe-485c-8118-9aebb08c2e62 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:22.499677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:22.504249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a697ece-e9fe-485c-8118-9aebb08c2e62 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:22.517963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195186f5-2eff-4ecb-88d2-ff0f69758ea7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:22.553310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd49d50-fb0e-4d7d-97c2-f8b113ccbce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:22.556229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd49d50-fb0e-4d7d-97c2-f8b113ccbce4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.556940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd49d50-fb0e-4d7d-97c2-f8b113ccbce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.557666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd49d50-fb0e-4d7d-97c2-f8b113ccbce4 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.559945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd49d50-fb0e-4d7d-97c2-f8b113ccbce4 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:22.563823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd49d50-fb0e-4d7d-97c2-f8b113ccbce4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:22.568112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 65/122] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:22 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:22.570714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986aa6-ab87-4923-9c1a-60b98108893f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.571442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986aa6-ab87-4923-9c1a-60b98108893f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.572141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83986aa6-ab87-4923-9c1a-60b98108893f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.598659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:22.599649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.600037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.600415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.608466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-83986aa6-ab87-4923-9c1a-60b98108893f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:22.611583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-83986aa6-ab87-4923-9c1a-60b98108893f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:22.614139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:22.624045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:22.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:22.627698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:22.629066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 58/123] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:22.630066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:22.737485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 66/124] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:22.738708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986aa6-ab87-4923-9c1a-60b98108893f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:22.791476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:22.835442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477bc8b8-d0ba-44d5-8708-a60d4040321a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:22.876770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:22.877829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.878209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.878587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] PATH_INFO: `/v3/users/20e59e7d825648b8a25362d3fc9a5d44` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.880037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] RBAC: Authorizing `identity:get_user(user_id=20e59e7d825648b8a25362d3fc9a5d44)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:22.881642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:22.885036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 59/125] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:22 2022] GET /identity/v3/users/20e59e7d825648b8a25362d3fc9a5d44 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:22.885036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:22.918973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:22.926641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83986aa6-ab87-4923-9c1a-60b98108893f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:22.990909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:22.992054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:22.992574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:22.993122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:22.994804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] RBAC: Adding query filter params (role.id=4ae1af3c48274e43b0350210bf332e0d, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=954fb356bbf442c1a471fb24c401eeeb) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:22.995387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:22.999341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:23.009184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda5f70-0928-4d52-9d6d-45339dc6fcd4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:23.010601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 67/126] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:22 2022] GET /identity/v3/role_assignments?user.id=954fb356bbf442c1a471fb24c401eeeb&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=4ae1af3c48274e43b0350210bf332e0d => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:23.012086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:23.081795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:23.082485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.082777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.083062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.083833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:23.084149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:23.085914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:23.101692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 60/127] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:23.102612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:23.131016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:23.205459 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c4ce5-6e49-4cb4-babf-1a74c88d6da0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:23.270215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:23.271746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.272263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.272776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.318461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:23.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:23.339051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 68/128] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:23.340025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:23.345454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b861720-e963-4f03-8b7f-01a0a9271b02 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:23.370886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:23.395959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707804a3-27b9-4266-8aae-333cf0167af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:23.397174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707804a3-27b9-4266-8aae-333cf0167af3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.397640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707804a3-27b9-4266-8aae-333cf0167af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.398093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707804a3-27b9-4266-8aae-333cf0167af3 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.399662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707804a3-27b9-4266-8aae-333cf0167af3 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:23.401342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707804a3-27b9-4266-8aae-333cf0167af3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:23.403259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 61/129] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:23 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:23.405270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3dc8-2317-4fd2-ae9d-64957a7aea56 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.405748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3dc8-2317-4fd2-ae9d-64957a7aea56 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.406315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc3dc8-2317-4fd2-ae9d-64957a7aea56 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.408187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 62/130] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:23.409107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc3dc8-2317-4fd2-ae9d-64957a7aea56 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:23.483842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f61a-675b-410c-8bb6-4edcb73320c3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:23.551067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:23.554659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa15c1-8818-4743-99e6-277320944d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:23.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa15c1-8818-4743-99e6-277320944d87 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.558234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa15c1-8818-4743-99e6-277320944d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.559136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa15c1-8818-4743-99e6-277320944d87 None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.561884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa15c1-8818-4743-99e6-277320944d87 None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:23.564107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa15c1-8818-4743-99e6-277320944d87 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:23.568147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 69/131] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:23 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:23.571869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a14f95-1302-4664-a345-c6eecc24b1b9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.572567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a14f95-1302-4664-a345-c6eecc24b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.573469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a14f95-1302-4664-a345-c6eecc24b1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.587023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc3dc8-2317-4fd2-ae9d-64957a7aea56 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:23.612762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-36a14f95-1302-4664-a345-c6eecc24b1b9 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:23.616136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-36a14f95-1302-4664-a345-c6eecc24b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:23.620926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:23.621716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.622148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.622537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.624570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:23.624570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:23.625558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:23.636953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 63/132] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:23.636953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:23.742389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 70/133] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:23.743325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a14f95-1302-4664-a345-c6eecc24b1b9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:23.765695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b0985-74b8-4aef-8593-37182b56f960 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:23.767753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:23.809173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:23.810388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.810715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.811530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06/users/20e59e7d825648b8a25362d3fc9a5d44/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.814265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] RBAC: Authorizing `identity:create_grant(project_id=45afb887c4d943998202e1bc7943bb06, user_id=20e59e7d825648b8a25362d3fc9a5d44, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:23.816219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:23.859640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a14f95-1302-4664-a345-c6eecc24b1b9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:23.894605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:23.899390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 64/134] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:23 2022] PUT /identity/v3/projects/45afb887c4d943998202e1bc7943bb06/users/20e59e7d825648b8a25362d3fc9a5d44/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:23.906296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:23.907620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:23.908833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:23.909348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:23.909865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:23.911468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:23.913421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:23.915686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 71/135] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:23 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:23.916973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:24.026275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:24.041527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fb3ba-706e-4038-893c-a351c3daf8cf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.079009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d732f-af2b-40e6-bf2b-40701c795a01 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.093320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.094547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.095116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.095597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.119543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:24.137270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:24.138186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:24.139711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:24.143827 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 72/136] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:24.145164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:24.166739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.167962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.168395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.168820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.170825 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:24.172843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:24.175565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 65/137] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:23 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:24.176671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:24.281581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:24.323150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d12e7c8-0b49-4f1d-889f-6c1e75da912c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.346070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff79a7a-5f80-4f8d-acf7-511e9721c6df None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.369797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.370898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.371391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.372176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.373780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:24.374890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:24.376969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:24.388209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 66/138] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:24.390579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:24.413863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d015ffc9-9e23-495e-9eb1-722800347ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.415476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ffc9-9e23-495e-9eb1-722800347ef6 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.415898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ffc9-9e23-495e-9eb1-722800347ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.416392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015ffc9-9e23-495e-9eb1-722800347ef6 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06/users/820e7098b5fc456da790361acd082164/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.419409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015ffc9-9e23-495e-9eb1-722800347ef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=45afb887c4d943998202e1bc7943bb06, user_id=820e7098b5fc456da790361acd082164, role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:24.421411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d015ffc9-9e23-495e-9eb1-722800347ef6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:24.497463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 73/139] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:24 2022] PUT /identity/v3/projects/45afb887c4d943998202e1bc7943bb06/users/820e7098b5fc456da790361acd082164/roles/e5e16600844f49db892c00085568f6e8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:24.499691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f4827-5157-4ccd-8e0b-2258853ec7e5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.500033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f4827-5157-4ccd-8e0b-2258853ec7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.500280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f4827-5157-4ccd-8e0b-2258853ec7e5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.502033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 74/140] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:24.502636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f4827-5157-4ccd-8e0b-2258853ec7e5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:24.521663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:24.570067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096d1d3-4ef9-483e-8b9a-e7bb92860e2a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.635898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:24.652146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ab6bb-8051-40e9-9ec2-2fb4a69eeafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.653070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ab6bb-8051-40e9-9ec2-2fb4a69eeafa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.653374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ab6bb-8051-40e9-9ec2-2fb4a69eeafa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.653632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ab6bb-8051-40e9-9ec2-2fb4a69eeafa None admin] PATH_INFO: `/v3/projects/606bbf88a1864cafad805264b9f81fa0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.657511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ab6bb-8051-40e9-9ec2-2fb4a69eeafa None admin] RBAC: Authorizing `identity:get_project(project_id=606bbf88a1864cafad805264b9f81fa0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:24.659029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ab6bb-8051-40e9-9ec2-2fb4a69eeafa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:24.665963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 67/141] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:24 2022] GET /identity/v3/projects/606bbf88a1864cafad805264b9f81fa0 => generated 312 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:24.668398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd392-5388-442f-b8fd-39c49682b158 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.668697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd392-5388-442f-b8fd-39c49682b158 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.668971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbd392-5388-442f-b8fd-39c49682b158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.692680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f4827-5157-4ccd-8e0b-2258853ec7e5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.708472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-35fbd392-5388-442f-b8fd-39c49682b158 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:24.709741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-35fbd392-5388-442f-b8fd-39c49682b158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:24.753437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd451-aead-483e-a9d2-af885337291c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.754338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd451-aead-483e-a9d2-af885337291c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.754623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd451-aead-483e-a9d2-af885337291c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.755013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394fd451-aead-483e-a9d2-af885337291c None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.756584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fd451-aead-483e-a9d2-af885337291c None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:24.759993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394fd451-aead-483e-a9d2-af885337291c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:24.762298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 75/142] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:24 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:24.763407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd451-aead-483e-a9d2-af885337291c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:24.807816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 68/143] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:24.808736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbd392-5388-442f-b8fd-39c49682b158 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:24.861364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:24.885078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394fd451-aead-483e-a9d2-af885337291c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.926990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.927959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.928364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.928674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] PATH_INFO: `/v3/projects/606bbf88a1864cafad805264b9f81fa0/users/820e7098b5fc456da790361acd082164/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:24.931120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=606bbf88a1864cafad805264b9f81fa0, user_id=820e7098b5fc456da790361acd082164, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:24.932815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:24.953768 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbd392-5388-442f-b8fd-39c49682b158 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:24.986884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:24.995182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:24.995837 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:24.996119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:24.996396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:25.019232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 76/144] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:24 2022] PUT /identity/v3/projects/606bbf88a1864cafad805264b9f81fa0/users/820e7098b5fc456da790361acd082164/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:25.023934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:25.082167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:25.083690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:25.205314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 69/145] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:25.211025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:25.245398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:25.298704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad07e9-27b7-494d-b7bc-10a955f299a0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:25.329849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17072f-d9c8-4f80-bc3d-7e0c625f2244 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:25.374654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:25.375627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:25.375912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:25.376186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:25.377506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:25.379104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:25.381092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 70/146] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:25 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:25.387488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:25.398739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:25.400229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:25.400702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:25.401218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:25.403394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:25.405773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:25.408297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 77/147] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:25.413508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:25.421245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:25.501678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:25.511187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41822fd-3d8e-493a-ab9c-b4313934fb02 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:25.585809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f21ef9-e4a6-4c82-be19-62a09d1dbc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:25.587335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21ef9-e4a6-4c82-be19-62a09d1dbc24 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:25.587620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21ef9-e4a6-4c82-be19-62a09d1dbc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:25.587895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f21ef9-e4a6-4c82-be19-62a09d1dbc24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:25.588754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21ef9-e4a6-4c82-be19-62a09d1dbc24 None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=820e7098b5fc456da790361acd082164) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:25.589091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21ef9-e4a6-4c82-be19-62a09d1dbc24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:25.590568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f21ef9-e4a6-4c82-be19-62a09d1dbc24 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:25.607656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 71/148] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:25 2022] GET /identity/v3/role_assignments?user.id=820e7098b5fc456da790361acd082164&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=82e9eb17bbd04cf888953955a1c648af => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:25.644122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536da300-d40a-4696-845e-7fee32a16033 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:25.699818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576b901a-d615-47f4-b810-ffe41848971d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:25.700532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b901a-d615-47f4-b810-ffe41848971d None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:25.700818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b901a-d615-47f4-b810-ffe41848971d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:25.701120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576b901a-d615-47f4-b810-ffe41848971d None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:25.702649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b901a-d615-47f4-b810-ffe41848971d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:25.704462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576b901a-d615-47f4-b810-ffe41848971d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:25.861711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 78/149] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:03:25 2022] POST /identity/v3/users => generated 283 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:26.012236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cecaed-22a2-4a73-8e60-bdfc82d02b15 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.012601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cecaed-22a2-4a73-8e60-bdfc82d02b15 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.012792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cecaed-22a2-4a73-8e60-bdfc82d02b15 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.014365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 72/150] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:26.020561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258f7e-d292-45f1-a8e2-74a01929fd24 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.020902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258f7e-d292-45f1-a8e2-74a01929fd24 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.021171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258f7e-d292-45f1-a8e2-74a01929fd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.041337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f2258f7e-d292-45f1-a8e2-74a01929fd24 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:26.042551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f2258f7e-d292-45f1-a8e2-74a01929fd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:26.115431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:26.131239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 79/151] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:26.154655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cecaed-22a2-4a73-8e60-bdfc82d02b15 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:26.276542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cecaed-22a2-4a73-8e60-bdfc82d02b15 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:26.317158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:26.317974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.318254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.318526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.331122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:26.339382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:26.340286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:26.341582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 73/152] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:26.351015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258f7e-d292-45f1-a8e2-74a01929fd24 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:26.512216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258f7e-d292-45f1-a8e2-74a01929fd24 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:26.558373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:26.559054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.559338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.559635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.560391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:26.561235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:26.563455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:26.574455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 80/153] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:26.581535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:26.616199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:26.715867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa385cc3-92c2-4b39-b26b-2605f8a223d3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:26.761545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a3c5d-060a-46ae-b529-ddf5e0320858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:26.762454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a3c5d-060a-46ae-b529-ddf5e0320858 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.762679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a3c5d-060a-46ae-b529-ddf5e0320858 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.763005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a3c5d-060a-46ae-b529-ddf5e0320858 None admin] PATH_INFO: `/v3/users/954fb356bbf442c1a471fb24c401eeeb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.768296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a3c5d-060a-46ae-b529-ddf5e0320858 None admin] RBAC: Authorizing `identity:get_user(user_id=954fb356bbf442c1a471fb24c401eeeb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:26.768296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a3c5d-060a-46ae-b529-ddf5e0320858 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:26.768296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 74/154] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:26 2022] GET /identity/v3/users/954fb356bbf442c1a471fb24c401eeeb => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:26.773918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:26.834905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca3d2b-fcf4-4bfa-b7d3-3dc85f0bc1a2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.835233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca3d2b-fcf4-4bfa-b7d3-3dc85f0bc1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.835475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca3d2b-fcf4-4bfa-b7d3-3dc85f0bc1a2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.836926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 75/155] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:26.842724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800748-6431-4069-aa66-6eeeebb2a786 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.843307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800748-6431-4069-aa66-6eeeebb2a786 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.843745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800748-6431-4069-aa66-6eeeebb2a786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.861377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:26.870955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-51800748-6431-4069-aa66-6eeeebb2a786 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:26.872231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51800748-6431-4069-aa66-6eeeebb2a786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:26.944748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c270cf2-5f8a-44fa-8f20-c6fdab212ad3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:26.984620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 76/156] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:26.990965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:26.992259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:26.992744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:26.993326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:26.994787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:26.996536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:26.998701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 81/157] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:26 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:27.006049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800748-6431-4069-aa66-6eeeebb2a786 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:27.014545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:27.032865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:27.200820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800748-6431-4069-aa66-6eeeebb2a786 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:27.220385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdd762-e2f3-47fa-9398-9059c57edada None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:27.261493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:27.268188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:27.268931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.269319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.269599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.279799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:27.280996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.283632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.283632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06/users/954fb356bbf442c1a471fb24c401eeeb/roles/4ae1af3c48274e43b0350210bf332e0d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.285803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=45afb887c4d943998202e1bc7943bb06, user_id=954fb356bbf442c1a471fb24c401eeeb, role_id=4ae1af3c48274e43b0350210bf332e0d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:27.287282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:27.293973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:27.303633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:27.304882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:27.306307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 82/158] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:27.312302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:27.379443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 77/159] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:27 2022] PUT /identity/v3/projects/45afb887c4d943998202e1bc7943bb06/users/954fb356bbf442c1a471fb24c401eeeb/roles/4ae1af3c48274e43b0350210bf332e0d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:27.437248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68f9aa7-4f21-4052-b33d-29857f3ac228 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:27.477571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc29cb1-72fb-41bf-97be-b9a2224ead5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:27.478269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc29cb1-72fb-41bf-97be-b9a2224ead5b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.478601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc29cb1-72fb-41bf-97be-b9a2224ead5b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.478890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc29cb1-72fb-41bf-97be-b9a2224ead5b None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.479671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc29cb1-72fb-41bf-97be-b9a2224ead5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:27.479979 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc29cb1-72fb-41bf-97be-b9a2224ead5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:27.481461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc29cb1-72fb-41bf-97be-b9a2224ead5b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:27.492068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 83/160] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:27.498015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:27.533249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8978d-1275-40f7-a425-bc557d3eaa02 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.533734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8978d-1275-40f7-a425-bc557d3eaa02 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.533734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a8978d-1275-40f7-a425-bc557d3eaa02 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.535402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 84/161] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:27.541532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333e6e-f679-4b5b-94c7-fb115b39a8c2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.541827 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333e6e-f679-4b5b-94c7-fb115b39a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.542103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a333e6e-f679-4b5b-94c7-fb115b39a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.562162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8a333e6e-f679-4b5b-94c7-fb115b39a8c2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:27.563464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8a333e6e-f679-4b5b-94c7-fb115b39a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:27.612359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:27.627230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:27.649484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 85/162] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:27.652449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac397fb-577d-42ce-9434-822df5949eeb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:27.674860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333e6e-f679-4b5b-94c7-fb115b39a8c2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:27.691778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:27.693028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.693028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.693464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] PATH_INFO: `/v3/users/20e59e7d825648b8a25362d3fc9a5d44` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.694888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] RBAC: Authorizing `identity:get_user(user_id=20e59e7d825648b8a25362d3fc9a5d44)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:27.696711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:27.703654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 78/163] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:27 2022] GET /identity/v3/users/20e59e7d825648b8a25362d3fc9a5d44 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:27.705149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:27.820267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a4db3-5c2e-48f9-886c-d8fcd6c81fb7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:27.824051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a333e6e-f679-4b5b-94c7-fb115b39a8c2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:27.861380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:27.862504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.862860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.863212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.891071 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:27.942370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:27.943206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:27.943496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:27.943780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:27.959603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:27.965916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:27.968281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:27.980161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:27.981187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:27.981954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 86/164] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:27.989185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:28.042762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:28.161944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382da20-16d8-4c3f-9839-3743145e6bf2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:28.166315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 79/165] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:03:28.172734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:28.203350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:28.204063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.204348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.204630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.205446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:28.205763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:28.207187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:28.218242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 87/166] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:28.224421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:28.255622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:28.345613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebc608-bd29-4ee5-b415-5c8f7e2a9fca None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:28.357074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d818-9a17-4d97-9cc9-c8c179a81bd8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:28.358178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:28.384071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:28.385548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.386005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.386361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.387739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:28.389590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:28.391509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 88/167] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:28 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:28.398252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:28.422178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:28.422987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.423269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.423545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.424881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:28.426401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:28.428470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 80/168] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:28 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:28.434425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:28.515849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554e5be-057b-40e9-9229-c0466698bdf9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:28.555271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:28.556281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.556708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.557093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.575806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a742f75d-0c9e-468d-96a4-bff03e0a693c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:28.591334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:28.596936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:28.634435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811bcd02-994e-4cbe-bd10-90450c8c9cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:28.635154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bcd02-994e-4cbe-bd10-90450c8c9cec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.635374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bcd02-994e-4cbe-bd10-90450c8c9cec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.635648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811bcd02-994e-4cbe-bd10-90450c8c9cec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.636505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bcd02-994e-4cbe-bd10-90450c8c9cec None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=20e59e7d825648b8a25362d3fc9a5d44) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:28.636816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bcd02-994e-4cbe-bd10-90450c8c9cec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:28.638320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811bcd02-994e-4cbe-bd10-90450c8c9cec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:28.642667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:28.644217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:28.654155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 81/169] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:28 2022] GET /identity/v3/role_assignments?user.id=20e59e7d825648b8a25362d3fc9a5d44&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:28.656598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95394a68-4ab0-4675-bb6d-6cfa7a993e33 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.656886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95394a68-4ab0-4675-bb6d-6cfa7a993e33 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.657196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95394a68-4ab0-4675-bb6d-6cfa7a993e33 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.658704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 82/170] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:28.664652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1fe7-ba4f-4147-9aba-7522f1ed9236 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.664968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1fe7-ba4f-4147-9aba-7522f1ed9236 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.665245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd1fe7-ba4f-4147-9aba-7522f1ed9236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.696553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8efd1fe7-ba4f-4147-9aba-7522f1ed9236 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:28.697765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8efd1fe7-ba4f-4147-9aba-7522f1ed9236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:28.772633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 89/171] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:03:28.778604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:28.827652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 83/172] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:28.865362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:28.886080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1fe7-ba4f-4147-9aba-7522f1ed9236 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:28.901009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3280fd00-050f-4fd0-8a6c-0274db262cf6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:28.940644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:28.941801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:28.942255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:28.942662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:28.944088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:28.945806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:28.948002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 90/173] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:28 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:28.954950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:29.079188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a854540-7d9c-4c93-bd05-18a81e813312 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:29.091309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd1fe7-ba4f-4147-9aba-7522f1ed9236 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:29.111525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:29.121993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:29.126444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:29.130258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:29.130258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:29.130258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:29.130258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] RBAC: Adding query filter params (role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=820e7098b5fc456da790361acd082164) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:29.130258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:29.131615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:29.138962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 91/174] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:28 2022] GET /identity/v3/role_assignments?user.id=820e7098b5fc456da790361acd082164&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=e5e16600844f49db892c00085568f6e8 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:29.158892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:29.160006 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:29.165122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:29.165122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:29.180128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:29.189163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:29.190106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:29.190867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 84/175] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:29.200308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:29.336934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187dc37-0e9e-4d88-9ac6-1f962032c0dc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:29.383568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:29.384269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:29.384564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:29.384834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:29.390435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:29.390808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:29.392230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:29.401982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 92/176] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:29.408284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:29.541393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90427133-73b5-41fe-bfe5-d4d6c5af4638 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:29.586479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:29.587373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:29.587659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:29.587940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] PATH_INFO: `/v3/users/820e7098b5fc456da790361acd082164` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:29.589268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] RBAC: Authorizing `identity:get_user(user_id=820e7098b5fc456da790361acd082164)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:29.590872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:29.593417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 85/177] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:29 2022] GET /identity/v3/users/820e7098b5fc456da790361acd082164 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:29.599406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:29.680912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:29.736239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6d703-6ae2-4a43-b11c-ca06776aa3e6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:29.781854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:29.782534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:29.782821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:29.783100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:29.870604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:29.872006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:29.934336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:29.983067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 93/178] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:29.988275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:30.041368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:30.120542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98976b10-9365-4765-94a1-395ada36bce7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:30.163429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71fbd4-f8d1-4b87-a5e5-280a125a1e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:30.164314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71fbd4-f8d1-4b87-a5e5-280a125a1e59 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.164598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71fbd4-f8d1-4b87-a5e5-280a125a1e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.164876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71fbd4-f8d1-4b87-a5e5-280a125a1e59 None admin] PATH_INFO: `/v3/projects/606bbf88a1864cafad805264b9f81fa0` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.166154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71fbd4-f8d1-4b87-a5e5-280a125a1e59 None admin] RBAC: Authorizing `identity:get_project(project_id=606bbf88a1864cafad805264b9f81fa0)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:30.167620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71fbd4-f8d1-4b87-a5e5-280a125a1e59 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:30.169555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 86/179] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:29 2022] GET /identity/v3/projects/606bbf88a1864cafad805264b9f81fa0 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:30.175814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:30.193243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a06d-6267-4a9c-893d-363bcf9d8cda None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.193546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a06d-6267-4a9c-893d-363bcf9d8cda None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.193801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3376a06d-6267-4a9c-893d-363bcf9d8cda None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.195517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 87/180] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:30.200780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211510f-bde7-4bf3-acbb-6596de9cc1ec None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.201125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211510f-bde7-4bf3-acbb-6596de9cc1ec None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.201945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211510f-bde7-4bf3-acbb-6596de9cc1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.219623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3211510f-bde7-4bf3-acbb-6596de9cc1ec None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:30.220831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3211510f-bde7-4bf3-acbb-6596de9cc1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:30.363708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 88/181] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:30.381452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120072e-3042-4883-b62b-b736d17ddef4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:30.422206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211510f-bde7-4bf3-acbb-6596de9cc1ec None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:30.458359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:30.459045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.459331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.459706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.460616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=606bbf88a1864cafad805264b9f81fa0, user.id=820e7098b5fc456da790361acd082164) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:30.460938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:30.462439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:30.469400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 94/182] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:30 2022] GET /identity/v3/role_assignments?user.id=820e7098b5fc456da790361acd082164&scope.project.id=606bbf88a1864cafad805264b9f81fa0&role.id=82e9eb17bbd04cf888953955a1c648af => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:30.471710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:30.557111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211510f-bde7-4bf3-acbb-6596de9cc1ec None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:30.600293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd362-a206-4880-99e5-db3ec12fd998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:30.601145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd362-a206-4880-99e5-db3ec12fd998 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.601435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd362-a206-4880-99e5-db3ec12fd998 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.601718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd362-a206-4880-99e5-db3ec12fd998 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.615225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdd362-a206-4880-99e5-db3ec12fd998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-99fdd362-a206-4880-99e5-db3ec12fd998 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:30.623174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:30.624771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:30.625940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 89/183] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:30.634149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:30.674993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:30.774378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9645a-53c8-4888-9fcd-5943293756ba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:30.818336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:30.819334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.819801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.820258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.821299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:30.821809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:30.823437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:30.823610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351ab8-423a-4b0b-9767-2ff5d1e57ccd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.824114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351ab8-423a-4b0b-9767-2ff5d1e57ccd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.824599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a351ab8-423a-4b0b-9767-2ff5d1e57ccd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.827015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 90/184] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:30.833355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ac1f-64cb-430d-818f-94e23ad59064 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.833900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ac1f-64cb-430d-818f-94e23ad59064 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.834354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e19ac1f-64cb-430d-818f-94e23ad59064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.835186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 95/185] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:30.844875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:30.861570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0e19ac1f-64cb-430d-818f-94e23ad59064 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:30.863061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0e19ac1f-64cb-430d-818f-94e23ad59064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:30.946423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:30.953065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 91/186] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:30.955749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57462f91-ac12-4c3e-89e4-ff099185145b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.956337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57462f91-ac12-4c3e-89e4-ff099185145b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.956765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57462f91-ac12-4c3e-89e4-ff099185145b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.963093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 92/187] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:30.965140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b69f5-831f-4b51-a7bf-3ca37f2d8fc7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:30.965358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b69f5-831f-4b51-a7bf-3ca37f2d8fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:30.965639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b69f5-831f-4b51-a7bf-3ca37f2d8fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:30.974562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ec4c6-1c67-4361-9bc2-ecc7c8e044fb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:30.984940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e25b69f5-831f-4b51-a7bf-3ca37f2d8fc7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:30.986240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e25b69f5-831f-4b51-a7bf-3ca37f2d8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:31.005102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.011128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3982096-a859-4358-9690-f04d50916be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.012012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3982096-a859-4358-9690-f04d50916be1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.012304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3982096-a859-4358-9690-f04d50916be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.012565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3982096-a859-4358-9690-f04d50916be1 None admin] PATH_INFO: `/v3/users/12d6dced352b48a8a69d53c686e59466` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.028537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3982096-a859-4358-9690-f04d50916be1 None admin] RBAC: Authorizing `identity:get_user(user_id=12d6dced352b48a8a69d53c686e59466)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:31.030236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3982096-a859-4358-9690-f04d50916be1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:31.032054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 96/188] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:30 2022] GET /identity/v3/users/12d6dced352b48a8a69d53c686e59466 => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:31.034309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f314a4-026b-4404-9381-9afbe221eb5f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.034309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f314a4-026b-4404-9381-9afbe221eb5f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.034309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f314a4-026b-4404-9381-9afbe221eb5f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.037136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 97/189] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:31.037277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f314a4-026b-4404-9381-9afbe221eb5f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.059616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 93/190] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:31.061121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b69f5-831f-4b51-a7bf-3ca37f2d8fc7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.147564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f314a4-026b-4404-9381-9afbe221eb5f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.171202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b69f5-831f-4b51-a7bf-3ca37f2d8fc7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.182579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238934b8-30cd-453f-9172-67ffbd4e60c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.183399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238934b8-30cd-453f-9172-67ffbd4e60c0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.183688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238934b8-30cd-453f-9172-67ffbd4e60c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.183964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238934b8-30cd-453f-9172-67ffbd4e60c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.193508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.196917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238934b8-30cd-453f-9172-67ffbd4e60c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-238934b8-30cd-453f-9172-67ffbd4e60c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:31.206344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:31.207691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:31.208654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 98/191] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:31.214087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3586a-bcd5-41a8-9aac-679a8c34d84b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.214087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3586a-bcd5-41a8-9aac-679a8c34d84b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.214087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3586a-bcd5-41a8-9aac-679a8c34d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.214484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.214484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.214484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.214484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.227669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c3d3586a-bcd5-41a8-9aac-679a8c34d84b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:31.228867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c3d3586a-bcd5-41a8-9aac-679a8c34d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:31.239923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.289689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:31.291183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:31.300118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 99/192] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:31.301399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3586a-bcd5-41a8-9aac-679a8c34d84b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.397631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 94/193] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:31.398520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.416626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3586a-bcd5-41a8-9aac-679a8c34d84b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.449381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.456370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.457278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.457558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.468475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.468608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.468700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:31.468700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:31.468700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 100/194] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:31.468700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.509308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a0fe8-4b52-47d9-bf06-bb16b4a421cd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.545598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.546276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.546559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.546832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.547596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:31.547902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:31.549344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:31.558268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 95/195] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:31.559139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.571608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1051b454-250f-4915-af0a-d4e12687bb59 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.607212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.608167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.608452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.608817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.620124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:31.628551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:31.629535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:31.630320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 101/196] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:31.630958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.670040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c884e-a74f-47a7-9a2a-8e7189fd3d79 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.687805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.695184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.707531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.708325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.708612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.708891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.710216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:31.711925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:31.713728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 96/197] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:31.715795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.739277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9c1e3-117d-480e-8217-68c8c8b65eaf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.775231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.776037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.776324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.776608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.777360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:31.778829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:31.822254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8879e03-8377-42fd-a967-68de534a279d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.856474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:31.857379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:31.857859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:31.858519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] PATH_INFO: `/v3/users/12d6dced352b48a8a69d53c686e59466` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:31.859406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] RBAC: Authorizing `identity:get_user(user_id=12d6dced352b48a8a69d53c686e59466)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:31.860937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:31.862653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 97/198] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/users/12d6dced352b48a8a69d53c686e59466 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:31.863439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.877352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 102/199] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:03:31 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:31.877352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:31.929274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:31.991857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598df37-0a1f-46bc-8b85-de761ce8775d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:31.992852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152432b9-59c2-4bb0-912d-08d5a896ad01 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:32.010473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:32.033335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:32.035304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:32.035304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:32.035304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:32.035573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:32.035800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:32.037129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:32.039280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:32.040027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:32.040298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:32.040577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:32.041482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=12d6dced352b48a8a69d53c686e59466) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:32.041792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:32.043256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:32.047327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 98/200] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:32.048124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:32.057401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 103/201] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:31 2022] GET /identity/v3/role_assignments?user.id=12d6dced352b48a8a69d53c686e59466&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:32.058565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:32.185448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee73824d-c3e0-4367-b709-da4bac4479b6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:32.204809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:32.230945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f36992-9a51-4c45-b9ea-a70a7334fe43 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:32.236572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:32.237298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:32.237583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:32.237860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:32.280848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:32.281904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:32.282194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:32.282481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] PATH_INFO: `/v3/users/954fb356bbf442c1a471fb24c401eeeb` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:32.284081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] RBAC: Authorizing `identity:get_user(user_id=954fb356bbf442c1a471fb24c401eeeb)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:32.286003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:32.287566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 104/202] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:32 2022] GET /identity/v3/users/954fb356bbf442c1a471fb24c401eeeb => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:32.292799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:32.333957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:32.335814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:32.352572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:32.412801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf7c2e-e1e1-4cc4-b879-71fe5a72f1ba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:32.450814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:32.452277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:32.452673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:32.453109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:32.455232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 99/203] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:32.466289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:32.493444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:32.528790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:32.531332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:32.599525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:32.634509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bd0e2-e7b1-4c9d-9a8b-734ca4dcbd67 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:32.658096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 105/204] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:03:32.663791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:32.683416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:32.684531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:32.684957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:32.686667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:32.690530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:32.692422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:32.697499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 100/205] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:32 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:32.704576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:32.893424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:32.903926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c6d5b-9f94-4ce0-9507-aa3b6acbb342 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:32.940106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98897f-415b-4b08-abc3-47c5a3bbf6b7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:32.965244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:32.966396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:32.966926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:32.968092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:32.969804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:32.972214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:32.975886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 106/206] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:32 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:32.985863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:33.015316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86e31f-40bf-4611-9234-03e78603e1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:33.016272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86e31f-40bf-4611-9234-03e78603e1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:33.016690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86e31f-40bf-4611-9234-03e78603e1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:33.017217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86e31f-40bf-4611-9234-03e78603e1c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:33.018215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86e31f-40bf-4611-9234-03e78603e1c2 None admin] RBAC: Adding query filter params (role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=12d6dced352b48a8a69d53c686e59466) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:33.018666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86e31f-40bf-4611-9234-03e78603e1c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:33.020316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86e31f-40bf-4611-9234-03e78603e1c2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:33.029033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:33.043320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 101/207] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:32 2022] GET /identity/v3/role_assignments?user.id=12d6dced352b48a8a69d53c686e59466&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=e5e16600844f49db892c00085568f6e8 => generated 259 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:33.147200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c10665-2a2b-4499-9949-91b624bfa3b3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:33.210934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc4a1de-d307-48df-80c5-d30592e4fdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:33.211887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4a1de-d307-48df-80c5-d30592e4fdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:33.212323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4a1de-d307-48df-80c5-d30592e4fdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:33.212747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc4a1de-d307-48df-80c5-d30592e4fdc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:33.213829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4a1de-d307-48df-80c5-d30592e4fdc8 None admin] RBAC: Adding query filter params (role.id=4ae1af3c48274e43b0350210bf332e0d, scope.project.id=45afb887c4d943998202e1bc7943bb06, user.id=954fb356bbf442c1a471fb24c401eeeb) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:33.214301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4a1de-d307-48df-80c5-d30592e4fdc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:33.215932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc4a1de-d307-48df-80c5-d30592e4fdc8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:33.226390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 107/208] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:32 2022] GET /identity/v3/role_assignments?user.id=954fb356bbf442c1a471fb24c401eeeb&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=4ae1af3c48274e43b0350210bf332e0d => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:34.639491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d30f-b654-408d-ae9a-b199684b395e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:34.639976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d30f-b654-408d-ae9a-b199684b395e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:34.640355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2d30f-b654-408d-ae9a-b199684b395e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:34.642974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 102/209] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:34.648516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0c037-11e6-41ad-acf5-4cbfe60fa646 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:34.649401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0c037-11e6-41ad-acf5-4cbfe60fa646 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:34.649888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0c037-11e6-41ad-acf5-4cbfe60fa646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:34.667860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4bc0c037-11e6-41ad-acf5-4cbfe60fa646 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:34.669404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4bc0c037-11e6-41ad-acf5-4cbfe60fa646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:34.688420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3fd3-ee24-43f1-a910-45d3597eba9d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:34.688753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3fd3-ee24-43f1-a910-45d3597eba9d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:34.689016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3fd3-ee24-43f1-a910-45d3597eba9d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:34.690611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 103/210] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:34.695729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec190-5f95-4444-acfc-26bb31668a95 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:34.696249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec190-5f95-4444-acfc-26bb31668a95 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:34.696739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bec190-5f95-4444-acfc-26bb31668a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:34.756399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-51bec190-5f95-4444-acfc-26bb31668a95 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:34.758456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51bec190-5f95-4444-acfc-26bb31668a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:34.784864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 108/211] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:34.797481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0880858-0984-4fa5-9e7e-70c81818deaa None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:34.797773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0880858-0984-4fa5-9e7e-70c81818deaa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:34.798046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0880858-0984-4fa5-9e7e-70c81818deaa None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:34.803377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 109/212] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:34.805214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727b47-6fde-4bd1-8c90-6d170192e7c0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:34.805508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727b47-6fde-4bd1-8c90-6d170192e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:34.805792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd727b47-6fde-4bd1-8c90-6d170192e7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:34.823959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bd727b47-6fde-4bd1-8c90-6d170192e7c0 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:34.825186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bd727b47-6fde-4bd1-8c90-6d170192e7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:34.827916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:34.844197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 104/213] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:34.849884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec190-5f95-4444-acfc-26bb31668a95 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:34.898960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 110/214] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:34.901982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727b47-6fde-4bd1-8c90-6d170192e7c0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:34.959945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:34.985364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bec190-5f95-4444-acfc-26bb31668a95 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.026576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd727b47-6fde-4bd1-8c90-6d170192e7c0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.033395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.034216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.034502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.034779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.047035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:35.055123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:35.056234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 105/215] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:35.057609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.073917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.075099 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.075528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.076082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.086168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:35.090751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:35.099570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:35.104269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 111/216] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:35.105197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.175892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d036a9f-dd82-4d2a-bf58-bf820c6df32c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.212725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.213617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.213907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.214235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.215717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:35.217967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:35.218586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64205760-e6a6-4b98-bbac-221d816b99e2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.220119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 106/217] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:35.225316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.230457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:35.257331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.258020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.258312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.258594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.259356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:35.259670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:35.261102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:35.273934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 112/218] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:35.274598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.380153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5bd8-f31e-44ee-8636-9709909d3e50 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.392889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:35.422953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.423632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.423919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.424201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.424972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:35.425311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:35.426777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:35.436254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 107/219] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:35.437170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.438430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca446d29-d17b-49a3-8362-d36f4b533e76 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.474538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa36b6-ae3c-48fd-8cfa-1b9e457695bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.475271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa36b6-ae3c-48fd-8cfa-1b9e457695bd None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.475566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa36b6-ae3c-48fd-8cfa-1b9e457695bd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.475850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa36b6-ae3c-48fd-8cfa-1b9e457695bd None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.476579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa36b6-ae3c-48fd-8cfa-1b9e457695bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:35.478066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa36b6-ae3c-48fd-8cfa-1b9e457695bd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:35.504939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:35.539523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442c55c-56c9-4f68-bae7-178c27533eb9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.568251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 113/220] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:03:35 2022] POST /identity/v3/users => generated 297 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:35.569682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0781b-ca31-4754-9e3f-5a0521b6dd1e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.569974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0781b-ca31-4754-9e3f-5a0521b6dd1e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.570480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0781b-ca31-4754-9e3f-5a0521b6dd1e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.571564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 114/221] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:35.572321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0781b-ca31-4754-9e3f-5a0521b6dd1e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.584262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ab6b5-56ad-4a32-b38a-121e1816f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.585277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ab6b5-56ad-4a32-b38a-121e1816f99f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.585562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ab6b5-56ad-4a32-b38a-121e1816f99f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.585836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ab6b5-56ad-4a32-b38a-121e1816f99f None admin] PATH_INFO: `/v3/users/12d6dced352b48a8a69d53c686e59466` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.587240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ab6b5-56ad-4a32-b38a-121e1816f99f None admin] RBAC: Authorizing `identity:get_user(user_id=12d6dced352b48a8a69d53c686e59466)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:35.588751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ab6b5-56ad-4a32-b38a-121e1816f99f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:35.590620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 108/222] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/users/12d6dced352b48a8a69d53c686e59466 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:35.592459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067744c6-991d-46f4-b18b-6fc2f1295b17 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.592745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067744c6-991d-46f4-b18b-6fc2f1295b17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.593165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067744c6-991d-46f4-b18b-6fc2f1295b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.613425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-067744c6-991d-46f4-b18b-6fc2f1295b17 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:35.614641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-067744c6-991d-46f4-b18b-6fc2f1295b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:35.691976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 109/223] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:35.698048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067744c6-991d-46f4-b18b-6fc2f1295b17 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.711515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0781b-ca31-4754-9e3f-5a0521b6dd1e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.736803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:35.759797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.760706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.761020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.761303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] PATH_INFO: `/v3/users/988b96ee8ebd4fcaa7aea4a4a2560ac3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.779446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] RBAC: Authorizing `identity:get_user(user_id=988b96ee8ebd4fcaa7aea4a4a2560ac3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:35.781826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:35.787294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 115/224] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/users/988b96ee8ebd4fcaa7aea4a4a2560ac3 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:35.787294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.794249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:35.852570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067744c6-991d-46f4-b18b-6fc2f1295b17 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.903415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.906462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.906462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.906462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.908175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:35.909690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:35.911496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 110/225] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:35.912284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:35.930351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fbfaa-66eb-4345-8c4d-06cfa6c13f6d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:35.982838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:35.983740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:35.984081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:35.984356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:35.996020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:36.005227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:36.006173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:36.007014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 116/226] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:36.007702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:36.047251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e2608-259f-45c5-b04c-8a85d48404ee None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:36.055433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:36.084485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:36.094667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:36.096289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:36.096831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:36.097275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:36.144697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbff070-177a-4305-b1a3-1e8fd25d4e7e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:36.189387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:36.191544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:36.191991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:36.192576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b/users/12d6dced352b48a8a69d53c686e59466/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:36.193584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:36.195161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:36.195284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] RBAC: Authorizing `identity:create_grant(project_id=74d14621b0374c92b384d824a365386b, user_id=12d6dced352b48a8a69d53c686e59466, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:36.196943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:36.298720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 117/227] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:36 2022] PUT /identity/v3/projects/74d14621b0374c92b384d824a365386b/users/12d6dced352b48a8a69d53c686e59466/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:36.298720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:36.328657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 111/228] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:36.336258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:36.402102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:36.475784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:36.483693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe0749-d1e1-426d-84d1-124f87e05e85 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:36.530858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:36.531660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:36.531948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:36.532229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:36.533020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:36.533388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:36.535809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:36.547495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 118/229] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:36.554372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:36.574722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e9fd35-59a2-4eb4-9af3-d2c4246ebd75 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:36.618532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:36.620128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:36.620942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:36.621663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:36.624117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:36.626051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:36.628878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 112/230] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:36 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:36.635179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:36.686596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8d12-5f57-4120-95a8-6c099fc4f574 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:36.734727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:36.735811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:36.736202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:36.736488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] PATH_INFO: `/v3/users/12d6dced352b48a8a69d53c686e59466` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:36.738071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] RBAC: Authorizing `identity:get_user(user_id=12d6dced352b48a8a69d53c686e59466)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:36.740231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:36.742558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 119/231] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:36 2022] GET /identity/v3/users/12d6dced352b48a8a69d53c686e59466 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:36.749361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:36.759910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:36.764197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c93f61-5f72-4970-bf75-3df2fc5e09fe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:36.776697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:36.805664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:36.806630 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:36.807135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:36.807612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:36.808737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=988b96ee8ebd4fcaa7aea4a4a2560ac3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:36.809261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:36.811822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:36.818751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 113/232] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:36 2022] GET /identity/v3/role_assignments?user.id=988b96ee8ebd4fcaa7aea4a4a2560ac3&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=82e9eb17bbd04cf888953955a1c648af => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:36.872073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc259dc-4949-4c3a-bffa-c6ab22508cf9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:36.915324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026c072d-1021-43f0-a6cd-c18b640f2542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:36.916226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c072d-1021-43f0-a6cd-c18b640f2542 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:36.916514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c072d-1021-43f0-a6cd-c18b640f2542 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:36.916796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026c072d-1021-43f0-a6cd-c18b640f2542 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:36.918119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c072d-1021-43f0-a6cd-c18b640f2542 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:36.919823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026c072d-1021-43f0-a6cd-c18b640f2542 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:36.922067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 120/233] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:36 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:36.929392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:37.078552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ea1ae-ebd9-49bb-bdc4-3d64e29d0ce7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:37.130948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048941c5-1405-48c2-82a9-61ce23ed9467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:37.131847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048941c5-1405-48c2-82a9-61ce23ed9467 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:37.132130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048941c5-1405-48c2-82a9-61ce23ed9467 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:37.132399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048941c5-1405-48c2-82a9-61ce23ed9467 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b/users/12d6dced352b48a8a69d53c686e59466/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:37.134682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048941c5-1405-48c2-82a9-61ce23ed9467 None admin] RBAC: Authorizing `identity:create_grant(project_id=74d14621b0374c92b384d824a365386b, user_id=12d6dced352b48a8a69d53c686e59466, role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:37.136190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048941c5-1405-48c2-82a9-61ce23ed9467 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:37.282818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 114/234] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:36 2022] PUT /identity/v3/projects/74d14621b0374c92b384d824a365386b/users/12d6dced352b48a8a69d53c686e59466/roles/e5e16600844f49db892c00085568f6e8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:38.207729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302ae2-f4ec-4564-ab8e-af129d211998 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:38.208244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302ae2-f4ec-4564-ab8e-af129d211998 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:38.208350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6302ae2-f4ec-4564-ab8e-af129d211998 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:38.209699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 121/235] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:38.215045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcc68-a685-4772-8b2c-8d852a406740 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:38.215885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcc68-a685-4772-8b2c-8d852a406740 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:38.216358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcc68-a685-4772-8b2c-8d852a406740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:38.234463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-437fcc68-a685-4772-8b2c-8d852a406740 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:38.235975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-437fcc68-a685-4772-8b2c-8d852a406740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:38.256242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:38.286055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab68530-3d97-4701-9c4a-7cab72965e7c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:38.286695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab68530-3d97-4701-9c4a-7cab72965e7c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:38.287168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab68530-3d97-4701-9c4a-7cab72965e7c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:38.288749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 122/236] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:38.300087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200533a-3a07-4061-89fe-8aca3b4a81f6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:38.304188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200533a-3a07-4061-89fe-8aca3b4a81f6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:38.304697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200533a-3a07-4061-89fe-8aca3b4a81f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:38.327951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4200533a-3a07-4061-89fe-8aca3b4a81f6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:38.329570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4200533a-3a07-4061-89fe-8aca3b4a81f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:38.331590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 115/237] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:38.386948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fcc68-a685-4772-8b2c-8d852a406740 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:38.478731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 123/238] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:38.512874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fcc68-a685-4772-8b2c-8d852a406740 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:38.525674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200533a-3a07-4061-89fe-8aca3b4a81f6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:38.568417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:38.576297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:38.577124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:38.577506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:38.577807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:38.601342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:38.609807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:38.610679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:38.611448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 116/239] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:38.618690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:38.649647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:38.737940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200533a-3a07-4061-89fe-8aca3b4a81f6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:38.804285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:38.809938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:38.810468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:38.811519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:38.817332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:38.820181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:38.823502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 124/240] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:38.832931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:38.854886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f906c-521e-4128-8d1c-65a7f0cb4bc8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:38.921497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:38.922677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:38.923196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:38.923708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:38.925233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:38.925811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:38.937762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:38.956785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 117/241] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:38.962117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:39.069495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:39.075908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f08b7-6398-4de7-a005-b65d07dc0dfc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:39.117813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:39.119076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:39.119983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.120272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.120554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] PATH_INFO: `/v3/users/9dad64331b8c44dba1d7148342f99bea` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.150417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7ae0f-104c-456d-8a32-f32c2b0aa270 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:39.154901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] RBAC: Authorizing `identity:get_user(user_id=9dad64331b8c44dba1d7148342f99bea)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:39.156832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:39.158942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 118/242] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:38 2022] GET /identity/v3/users/9dad64331b8c44dba1d7148342f99bea => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:39.164333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:39.214667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062bed35-742f-455e-a512-41398d87f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:39.215470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bed35-742f-455e-a512-41398d87f64c None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.215868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bed35-742f-455e-a512-41398d87f64c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.216150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bed35-742f-455e-a512-41398d87f64c None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.217780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bed35-742f-455e-a512-41398d87f64c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:39.220530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062bed35-742f-455e-a512-41398d87f64c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:39.290692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846e554-994b-48c1-86e6-b23fc8d2cc76 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:39.310020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 125/243] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:03:38 2022] POST /identity/v3/users => generated 293 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:03:39.313035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e02fc-65f0-4b4c-8b7a-ecd1328c58ac None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.313595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e02fc-65f0-4b4c-8b7a-ecd1328c58ac None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.314067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e02fc-65f0-4b4c-8b7a-ecd1328c58ac None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.315880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 126/244] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:39.321820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23209-7150-432c-84a7-f1305b2a1674 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.322367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23209-7150-432c-84a7-f1305b2a1674 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.322858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d23209-7150-432c-84a7-f1305b2a1674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.360670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b0d23209-7150-432c-84a7-f1305b2a1674 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:39.362486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b0d23209-7150-432c-84a7-f1305b2a1674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:39.375521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9d28-db82-41f4-ae40-56ba9b3e1c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:39.376565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9d28-db82-41f4-ae40-56ba9b3e1c21 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.376565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9d28-db82-41f4-ae40-56ba9b3e1c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.376761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9d28-db82-41f4-ae40-56ba9b3e1c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.385463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:39.480851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e9d28-db82-41f4-ae40-56ba9b3e1c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:39.483696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e9d28-db82-41f4-ae40-56ba9b3e1c21 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:39.569691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 127/245] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:39.593178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23209-7150-432c-84a7-f1305b2a1674 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:39.595140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 119/246] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:39.596770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bba009-fe97-493e-a05c-39c5478cc3d5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.597282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bba009-fe97-493e-a05c-39c5478cc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.597743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bba009-fe97-493e-a05c-39c5478cc3d5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.599656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 120/247] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:39.600626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bba009-fe97-493e-a05c-39c5478cc3d5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:39.643169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:39.729844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:39.739994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bba009-fe97-493e-a05c-39c5478cc3d5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:39.771975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d23209-7150-432c-84a7-f1305b2a1674 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:39.791091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40449a9-24ae-4c3a-a61c-33a1be3827b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:39.795571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40449a9-24ae-4c3a-a61c-33a1be3827b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.795571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40449a9-24ae-4c3a-a61c-33a1be3827b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.795571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40449a9-24ae-4c3a-a61c-33a1be3827b0 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.795571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40449a9-24ae-4c3a-a61c-33a1be3827b0 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:39.796186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40449a9-24ae-4c3a-a61c-33a1be3827b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:39.799093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 121/248] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:39 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:39.803010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d2a9-89ef-4e92-93a4-36a3603aaa3b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.804367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d2a9-89ef-4e92-93a4-36a3603aaa3b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.805403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4d2a9-89ef-4e92-93a4-36a3603aaa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.825331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:39.826733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:39.827020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:39.827300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:39.829868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7ab4d2a9-89ef-4e92-93a4-36a3603aaa3b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:39.831387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7ab4d2a9-89ef-4e92-93a4-36a3603aaa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:39.845487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:39.855227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:39.856187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:39.857463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 128/249] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:39.858835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:39.941266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 122/250] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:39.943240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4d2a9-89ef-4e92-93a4-36a3603aaa3b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:40.007701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:40.030154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef67006d-f10b-4e1e-97c9-91d0b9eee0ed None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:40.101940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:40.102531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.102816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.103092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:40.103937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] RBAC: Adding query filter params (role.id=4ae1af3c48274e43b0350210bf332e0d, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=9dad64331b8c44dba1d7148342f99bea) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:40.104248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:40.105736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:40.113566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:40.118049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 129/251] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:39 2022] GET /identity/v3/role_assignments?user.id=9dad64331b8c44dba1d7148342f99bea&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=4ae1af3c48274e43b0350210bf332e0d => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:40.119321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:40.164015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4d2a9-89ef-4e92-93a4-36a3603aaa3b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:40.248245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:40.249970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.250302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.250586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:40.251398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:40.251712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:40.253164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:40.272588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 123/252] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:40.278734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:40.344418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9951b-846b-4d04-89b7-d8467c549510 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:40.418314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:40.425462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae65051-42b1-4960-a194-2ac48019d06a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:40.429580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d824952-60fd-4271-bfe6-70921c036aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:40.430615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d824952-60fd-4271-bfe6-70921c036aad None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.436234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d824952-60fd-4271-bfe6-70921c036aad None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.436234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d824952-60fd-4271-bfe6-70921c036aad None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:40.448229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d824952-60fd-4271-bfe6-70921c036aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8d824952-60fd-4271-bfe6-70921c036aad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:40.459960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:40.460884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:40.461691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:40.464443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 130/253] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:40.466206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852e6b4-e26f-43d4-aa5a-63c9b194eff2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.466876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852e6b4-e26f-43d4-aa5a-63c9b194eff2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.467994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852e6b4-e26f-43d4-aa5a-63c9b194eff2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:40.470138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 131/254] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:40.471908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852e6b4-e26f-43d4-aa5a-63c9b194eff2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:40.473814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be0f6a-7c5f-4a06-ad45-7b8fa895d306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:40.474962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be0f6a-7c5f-4a06-ad45-7b8fa895d306 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.475249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be0f6a-7c5f-4a06-ad45-7b8fa895d306 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.475526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be0f6a-7c5f-4a06-ad45-7b8fa895d306 None admin] PATH_INFO: `/v3/users/12d6dced352b48a8a69d53c686e59466` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:40.476958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be0f6a-7c5f-4a06-ad45-7b8fa895d306 None admin] RBAC: Authorizing `identity:get_user(user_id=12d6dced352b48a8a69d53c686e59466)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:40.478795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be0f6a-7c5f-4a06-ad45-7b8fa895d306 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:40.480480 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 124/255] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:40 2022] GET /identity/v3/users/12d6dced352b48a8a69d53c686e59466 => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:40.486059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63137489-5b1e-468b-85a6-3552ae8aaf20 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.486403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63137489-5b1e-468b-85a6-3552ae8aaf20 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.486641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63137489-5b1e-468b-85a6-3552ae8aaf20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:40.507844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63137489-5b1e-468b-85a6-3552ae8aaf20 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:40.509231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63137489-5b1e-468b-85a6-3552ae8aaf20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:40.561365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:40.644571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852e6b4-e26f-43d4-aa5a-63c9b194eff2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:40.660850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 125/256] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:40.661568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63137489-5b1e-468b-85a6-3552ae8aaf20 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:40.699707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:40.700305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.700590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.700872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:40.702554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:40.702981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:40.704385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:40.714272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 132/257] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:40.715196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:40.900489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:40.921684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63137489-5b1e-468b-85a6-3552ae8aaf20 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:40.957207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2262d6be-ce8f-4fc3-a7e6-fa4fcef5b653 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:40.985289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:40.995909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:40.996585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:40.999862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:40.999862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:41.026044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:41.026906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:41.027199 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:41.027545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:41.051042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:41.068023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:41.068998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:41.069773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 133/258] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:41.070408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:41.079593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:41.081110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:41.185243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:41.200612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 126/259] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:41.203198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:41.295528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344a8103-b535-45e6-bb8c-5541ebf6cfba None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:41.365671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:41.366551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:41.366833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:41.367108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] PATH_INFO: `/v3/users/988b96ee8ebd4fcaa7aea4a4a2560ac3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:41.371273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] RBAC: Authorizing `identity:get_user(user_id=988b96ee8ebd4fcaa7aea4a4a2560ac3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:41.374893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:41.376626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 134/260] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:41 2022] GET /identity/v3/users/988b96ee8ebd4fcaa7aea4a4a2560ac3 => generated 297 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:41.377531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:41.410992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153ab1d-b0b2-47fa-be00-5eddadfd6d49 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:41.451227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:41.452635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:41.452874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:41.453134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:41.453892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:41.454199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:41.455574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:41.464371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 127/261] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:41.465198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:41.528419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:41.557431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:41.584082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a15c5-ed1d-45ab-8b5c-4bf06a67db55 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:41.637755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:41.638682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:41.638966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:41.639247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:41.643537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:41.645058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:41.646995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 128/262] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:41 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:41.647631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:41.675413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5117db-f71e-4833-8db9-e09021b1d0fa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:41.748845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:41.749785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:41.750075 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:41.750363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:41.751786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:41.754478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:41.757112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 135/263] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:41 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:41.758510 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:41.855387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f479-8979-4c4e-aec1-a7b99c9afa88 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:41.903466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:41.930348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:41.931294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:41.931605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:41.931885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] PATH_INFO: `/v3/users/12d6dced352b48a8a69d53c686e59466` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:41.933403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] RBAC: Authorizing `identity:get_user(user_id=12d6dced352b48a8a69d53c686e59466)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:41.934877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:41.937197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 129/264] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:41 2022] GET /identity/v3/users/12d6dced352b48a8a69d53c686e59466 => generated 283 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:41.937998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:41.975031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756af337-226c-44d5-aed2-05a5d35ecc26 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:42.017341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:42.074316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d4024-896c-48d5-88ae-ae104ec4c1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:42.075234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d4024-896c-48d5-88ae-ae104ec4c1d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.075521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d4024-896c-48d5-88ae-ae104ec4c1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.075801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d4024-896c-48d5-88ae-ae104ec4c1d3 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b/users/988b96ee8ebd4fcaa7aea4a4a2560ac3/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.082446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d4024-896c-48d5-88ae-ae104ec4c1d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=74d14621b0374c92b384d824a365386b, user_id=988b96ee8ebd4fcaa7aea4a4a2560ac3, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:42.083922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d4024-896c-48d5-88ae-ae104ec4c1d3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:42.093167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad0507-7955-48ef-a281-508cc3a10808 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:42.133674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:42.134326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.134614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.134894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.135839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=12d6dced352b48a8a69d53c686e59466) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:42.136158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:42.137724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:42.145510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 130/265] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:41 2022] GET /identity/v3/role_assignments?user.id=12d6dced352b48a8a69d53c686e59466&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:42.146211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:42.205080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 136/266] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:41 2022] PUT /identity/v3/projects/74d14621b0374c92b384d824a365386b/users/988b96ee8ebd4fcaa7aea4a4a2560ac3/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:42.218660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:42.260308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc2ae-4feb-46ba-a403-faa7008b389e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.260649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc2ae-4feb-46ba-a403-faa7008b389e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.260879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc2ae-4feb-46ba-a403-faa7008b389e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.262845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 137/267] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:42.269692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc246-8648-4ade-8725-13f623628192 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.270093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc246-8648-4ade-8725-13f623628192 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.270382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdc246-8648-4ade-8725-13f623628192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.274086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353ef8b-25f3-4280-828f-3d03f3b4233d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:42.292008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d4fdc246-8648-4ade-8725-13f623628192 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:42.295953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d4fdc246-8648-4ade-8725-13f623628192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:42.325030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:42.325725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.326012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.326904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.423937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:42.425803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:42.474951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 138/268] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:42.476387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9685-f9eb-4679-97a1-34625084efda None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.476894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9685-f9eb-4679-97a1-34625084efda None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.477412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a9685-f9eb-4679-97a1-34625084efda None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 139/269] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:42.485606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ddaa-3ce3-4949-876e-daacb6595560 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.486199 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ddaa-3ce3-4949-876e-daacb6595560 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.486697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d93ddaa-3ce3-4949-876e-daacb6595560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.507157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0d93ddaa-3ce3-4949-876e-daacb6595560 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:42.509251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0d93ddaa-3ce3-4949-876e-daacb6595560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:42.515329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:42.586825 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 131/270] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:42.588377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:42.604490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 140/271] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:42.605847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ddaa-3ce3-4949-876e-daacb6595560 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:42.689353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:42.720564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bbefc-ca39-495a-bd5e-1878b8956b02 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:42.761248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:42.762061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.762346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.762717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.763922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:42.765571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:42.767489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 132/272] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:42.768093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:42.786839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d93ddaa-3ce3-4949-876e-daacb6595560 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:42.794144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:42.825606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b153be-1dd6-4130-ac75-089a6a2e8e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:42.826613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b153be-1dd6-4130-ac75-089a6a2e8e94 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.827112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b153be-1dd6-4130-ac75-089a6a2e8e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.827402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b153be-1dd6-4130-ac75-089a6a2e8e94 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.828625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b153be-1dd6-4130-ac75-089a6a2e8e94 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:42.830125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b153be-1dd6-4130-ac75-089a6a2e8e94 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:42.836574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 141/273] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:42 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:42.836574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e53d8-8818-40fe-8865-d0f684905c3a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.836574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e53d8-8818-40fe-8865-d0f684905c3a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.836574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e53d8-8818-40fe-8865-d0f684905c3a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.836574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 142/274] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:42.836574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e53d8-8818-40fe-8865-d0f684905c3a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:42.883560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbf016-d620-4322-b28a-338d1841ed85 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:42.922133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:42.923228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.923228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:42.923497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:42.934877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:42.943596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:42.944647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 133/275] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:42.945676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:42.960808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e53d8-8818-40fe-8865-d0f684905c3a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:42.969723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:42.997673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea498e-6348-4835-b69d-8d16db76d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:42.999290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea498e-6348-4835-b69d-8d16db76d9b8 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:42.999903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea498e-6348-4835-b69d-8d16db76d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.000317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea498e-6348-4835-b69d-8d16db76d9b8 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.001287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea498e-6348-4835-b69d-8d16db76d9b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:43.002736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea498e-6348-4835-b69d-8d16db76d9b8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:43.035609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:43.053349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4175ae-1247-40db-bad4-4a546486786c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:43.084209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 143/276] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:03:42 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:03:43.085643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbf05f-159f-4fd7-8802-e57c8b8fca82 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.086012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbf05f-159f-4fd7-8802-e57c8b8fca82 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.086205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbf05f-159f-4fd7-8802-e57c8b8fca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.091432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:43.092689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.093314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.093806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.095013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] RBAC: Adding query filter params (role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=12d6dced352b48a8a69d53c686e59466) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:43.095627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:43.097398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:43.105959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 134/277] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:42 2022] GET /identity/v3/role_assignments?user.id=12d6dced352b48a8a69d53c686e59466&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=e5e16600844f49db892c00085568f6e8 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:43.107400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:43.114360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-59dbf05f-159f-4fd7-8802-e57c8b8fca82 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:43.115649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-59dbf05f-159f-4fd7-8802-e57c8b8fca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:43.247492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f44d1-4041-4cc5-8849-670b8adf5b26 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:43.290393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 144/278] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:43.307894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:43.308945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.309472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.309970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.311608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:43.312173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:43.313891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:43.322413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbf05f-159f-4fd7-8802-e57c8b8fca82 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:43.331599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 135/279] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:43.337901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:43.356460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:43.449977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:43.461902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbf05f-159f-4fd7-8802-e57c8b8fca82 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:43.479131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bb42d-629c-4cea-a439-24997933b566 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:43.508662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:43.510184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.510646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.511079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.526171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:43.526804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:43.528253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.528536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.528812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] PATH_INFO: `/v3/users/ff5ab9a2647e4bb5bc6f546748c8212f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:43.536182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:43.537180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:43.537965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 145/280] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:43.547792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:43.553479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] RBAC: Authorizing `identity:get_user(user_id=ff5ab9a2647e4bb5bc6f546748c8212f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:43.555371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:43.559381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 136/281] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:43 2022] GET /identity/v3/users/ff5ab9a2647e4bb5bc6f546748c8212f => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:43.565394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:43.648726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:43.692148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ea12b-6330-4683-9ab4-b8b696aff17b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:43.696455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5173a627-f2f6-4dd0-8785-af3887129743 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:43.734321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:43.735324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.735808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.736255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.737209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:43.737709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:43.739390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:43.753220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 146/282] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:43.756777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:43.775434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:43.805738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:43.806464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.806751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.807059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.807916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, user.id=ff5ab9a2647e4bb5bc6f546748c8212f, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:43.808236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:43.809878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:43.824630 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 137/283] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 18 06:03:43 2022] GET /identity/v3/role_assignments?user.id=ff5ab9a2647e4bb5bc6f546748c8212f&scope.system=all&role.id=82e9eb17bbd04cf888953955a1c648af => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:43.875690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314fd35-6ac1-4cc7-93e3-9bd7758befaa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:43.916101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:43.917391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:43.917854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:43.918311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] PATH_INFO: `/v3/users/9dad64331b8c44dba1d7148342f99bea` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:43.919966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] RBAC: Authorizing `identity:get_user(user_id=9dad64331b8c44dba1d7148342f99bea)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:43.922272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:43.924430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 147/284] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:43 2022] GET /identity/v3/users/9dad64331b8c44dba1d7148342f99bea => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:43.930725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:44.167951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b13db-dc9f-4652-968e-7a4198b605db None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:44.224761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:44.234405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19e8e6-7629-4439-8a13-d67ffa936994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:44.235985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e8e6-7629-4439-8a13-d67ffa936994 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:44.236497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e8e6-7629-4439-8a13-d67ffa936994 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:44.237026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e8e6-7629-4439-8a13-d67ffa936994 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:44.239330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19e8e6-7629-4439-8a13-d67ffa936994 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:44.242238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19e8e6-7629-4439-8a13-d67ffa936994 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:44.245895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 138/285] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:43 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:44.252062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:44.398527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:44.424624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b7512-bd2b-47f7-bed2-4ff97666377a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:44.478606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f024cb4-3c6a-4658-963c-be74f799ac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:44.479524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f024cb4-3c6a-4658-963c-be74f799ac5b None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:44.479813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f024cb4-3c6a-4658-963c-be74f799ac5b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:44.480089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f024cb4-3c6a-4658-963c-be74f799ac5b None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b/users/9dad64331b8c44dba1d7148342f99bea/roles/4ae1af3c48274e43b0350210bf332e0d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:44.482183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f024cb4-3c6a-4658-963c-be74f799ac5b None admin] RBAC: Authorizing `identity:create_grant(project_id=74d14621b0374c92b384d824a365386b, user_id=9dad64331b8c44dba1d7148342f99bea, role_id=4ae1af3c48274e43b0350210bf332e0d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:44.483890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f024cb4-3c6a-4658-963c-be74f799ac5b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:44.553588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 148/286] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:03:44 2022] PUT /identity/v3/projects/74d14621b0374c92b384d824a365386b/users/9dad64331b8c44dba1d7148342f99bea/roles/4ae1af3c48274e43b0350210bf332e0d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:44.662893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333a44a-afae-454c-b219-2754a6a17ef3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:44.663558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333a44a-afae-454c-b219-2754a6a17ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:44.663558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333a44a-afae-454c-b219-2754a6a17ef3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:44.664972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 139/287] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:44.671751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8537a-2bb3-4c87-a551-4450e5d6d9fb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:44.672069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8537a-2bb3-4c87-a551-4450e5d6d9fb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:44.672302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8537a-2bb3-4c87-a551-4450e5d6d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:44.691588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-33a8537a-2bb3-4c87-a551-4450e5d6d9fb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:44.692416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-33a8537a-2bb3-4c87-a551-4450e5d6d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:44.795362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 149/288] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:44.828091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333a44a-afae-454c-b219-2754a6a17ef3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:44.954884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333a44a-afae-454c-b219-2754a6a17ef3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:44.991083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:44.991888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:44.992304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:44.992578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:45.003981 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:45.011762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:45.013815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:45.015019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 140/289] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:45.019692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8537a-2bb3-4c87-a551-4450e5d6d9fb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:45.098209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:45.130493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8537a-2bb3-4c87-a551-4450e5d6d9fb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:45.173721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:45.174403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:45.174687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:45.174961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:45.175925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:45.176238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:45.177672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:45.193093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 150/290] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:45.202400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:45.333378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:45.403873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a573df3f-9d15-4ba8-9a15-7ff1f3fe7ab6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:45.451019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:45.453121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:45.453411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:45.453687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] PATH_INFO: `/v3/users/988b96ee8ebd4fcaa7aea4a4a2560ac3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:45.455004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] RBAC: Authorizing `identity:get_user(user_id=988b96ee8ebd4fcaa7aea4a4a2560ac3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:45.456473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:45.458264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 141/291] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:45 2022] GET /identity/v3/users/988b96ee8ebd4fcaa7aea4a4a2560ac3 => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:45.463992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:45.593971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161bb81-283e-4df8-aa8b-571de5c87de2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:45.641773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb1bdbf-3c6e-42c5-822f-6ec1d13f0e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:45.642446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bdbf-3c6e-42c5-822f-6ec1d13f0e44 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:45.642731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bdbf-3c6e-42c5-822f-6ec1d13f0e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:45.643009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb1bdbf-3c6e-42c5-822f-6ec1d13f0e44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:45.645900 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:45.726207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bdbf-3c6e-42c5-822f-6ec1d13f0e44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:45.727847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb1bdbf-3c6e-42c5-822f-6ec1d13f0e44 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:45.840437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 151/292] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:45.846778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:45.980157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcadc63-d5a6-4a75-befb-0c2fad78c720 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:45.980815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcadc63-d5a6-4a75-befb-0c2fad78c720 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:45.981317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcadc63-d5a6-4a75-befb-0c2fad78c720 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:45.983616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 152/293] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:45.990202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dc5af-a628-4cd3-a209-bdfca59f1559 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:45.990881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dc5af-a628-4cd3-a209-bdfca59f1559 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:45.991385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108dc5af-a628-4cd3-a209-bdfca59f1559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.002307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d201636-a61c-4cb1-9dc5-690d67334a7f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:46.023778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-108dc5af-a628-4cd3-a209-bdfca59f1559 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:46.025346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-108dc5af-a628-4cd3-a209-bdfca59f1559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:46.057707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:46.073558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:46.074428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.086070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.086070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.086070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:46.086070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:46.086070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 142/294] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:45 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:46.086494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:46.087756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:46.183797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 153/295] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:46.206492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111f95-7a65-44b6-b385-46a2b52efa55 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.206777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111f95-7a65-44b6-b385-46a2b52efa55 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.207061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c111f95-7a65-44b6-b385-46a2b52efa55 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.208743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 154/296] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:03:46.214343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9780b79-9d26-413d-893f-b02031a2dc8d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.214635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9780b79-9d26-413d-893f-b02031a2dc8d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.214924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9780b79-9d26-413d-893f-b02031a2dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.237573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fee3b-d76c-41ef-a53b-4db6588bb9fd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:46.238744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d9780b79-9d26-413d-893f-b02031a2dc8d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:46.240183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d9780b79-9d26-413d-893f-b02031a2dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:46.276786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:46.277484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.277776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.278234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.279840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=988b96ee8ebd4fcaa7aea4a4a2560ac3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:46.280528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:46.282517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:46.290351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 143/297] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:46 2022] GET /identity/v3/role_assignments?user.id=988b96ee8ebd4fcaa7aea4a4a2560ac3&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=82e9eb17bbd04cf888953955a1c648af => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:46.291607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:46.325160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 155/298] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:46.354692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9780b79-9d26-413d-893f-b02031a2dc8d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:46.385776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:46.431078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17bb0e-2eb9-483b-87ab-839825fc0505 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:46.473096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:46.474139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.474562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.474976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.488138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:46.496691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:46.497673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:46.498955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:46.501192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 144/299] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:46.507213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:46.594406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:46.615140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9780b79-9d26-413d-893f-b02031a2dc8d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:46.677989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344e7555-7755-4c71-8bd1-f220afbbdc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:46.679370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7555-7755-4c71-8bd1-f220afbbdc86 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.679516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62196333-d00f-4831-9fff-1a66fd7235c3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:46.680159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7555-7755-4c71-8bd1-f220afbbdc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.680934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e7555-7755-4c71-8bd1-f220afbbdc86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.683085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e7555-7755-4c71-8bd1-f220afbbdc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:46.686296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344e7555-7755-4c71-8bd1-f220afbbdc86 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:46.690390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 156/300] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:46.692018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7d36-aac3-41f6-ae6c-da23eabcbd78 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.692486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7d36-aac3-41f6-ae6c-da23eabcbd78 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.692948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be7d36-aac3-41f6-ae6c-da23eabcbd78 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.694479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 157/301] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:46.695855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7d36-aac3-41f6-ae6c-da23eabcbd78 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:46.709857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:46.735947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862d578-dbda-4f41-8830-bd06668ee87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:46.736862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862d578-dbda-4f41-8830-bd06668ee87c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.737349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862d578-dbda-4f41-8830-bd06668ee87c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.737861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862d578-dbda-4f41-8830-bd06668ee87c None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.738796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862d578-dbda-4f41-8830-bd06668ee87c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:46.739269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862d578-dbda-4f41-8830-bd06668ee87c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:46.740865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1862d578-dbda-4f41-8830-bd06668ee87c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:46.753289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 145/302] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:46.754465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df390-3465-41d3-b302-0c2ea0299116 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.754756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df390-3465-41d3-b302-0c2ea0299116 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.755033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456df390-3465-41d3-b302-0c2ea0299116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.774154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-456df390-3465-41d3-b302-0c2ea0299116 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:46.775342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-456df390-3465-41d3-b302-0c2ea0299116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:46.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be7d36-aac3-41f6-ae6c-da23eabcbd78 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:46.854455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 146/303] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:46.855314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456df390-3465-41d3-b302-0c2ea0299116 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:46.868591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4481447-09e0-4e08-8805-395912962743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:46.869615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481447-09e0-4e08-8805-395912962743 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:46.870100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481447-09e0-4e08-8805-395912962743 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:46.870572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4481447-09e0-4e08-8805-395912962743 None admin] PATH_INFO: `/v3/groups` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:46.871620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4481447-09e0-4e08-8805-395912962743 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:46.873192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4481447-09e0-4e08-8805-395912962743 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:46.963104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 158/304] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Jul 18 06:03:46 2022] POST /identity/v3/groups => generated 229 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:03:46.963997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4481447-09e0-4e08-8805-395912962743 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:46.982127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456df390-3465-41d3-b302-0c2ea0299116 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:46.996270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:47.003409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:47.039740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.040661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.040944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.041249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] PATH_INFO: `/v3/users/4facc5fa54c744eaa1fd58a016f6f2a2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.059676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] RBAC: Authorizing `identity:get_user(user_id=4facc5fa54c744eaa1fd58a016f6f2a2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:47.061304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:47.063101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 147/305] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:46 2022] GET /identity/v3/users/4facc5fa54c744eaa1fd58a016f6f2a2 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:47.070369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:47.106085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4481447-09e0-4e08-8805-395912962743 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.153674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.154898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.155389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.155877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.171142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:47.179528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:47.180448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:47.181377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 159/306] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:47.188540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:47.209387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf4964-1a0d-4b40-84cf-1b5722757f56 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.247756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022c03c-a023-414c-a19c-2e606c05aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.249213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022c03c-a023-414c-a19c-2e606c05aa3a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.249538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022c03c-a023-414c-a19c-2e606c05aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.249868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022c03c-a023-414c-a19c-2e606c05aa3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.250724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022c03c-a023-414c-a19c-2e606c05aa3a None admin] RBAC: Adding query filter params (role.id=4ae1af3c48274e43b0350210bf332e0d, user.id=4facc5fa54c744eaa1fd58a016f6f2a2, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:47.251034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022c03c-a023-414c-a19c-2e606c05aa3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:47.252508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022c03c-a023-414c-a19c-2e606c05aa3a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:47.258442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 148/307] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 18 06:03:47 2022] GET /identity/v3/role_assignments?user.id=4facc5fa54c744eaa1fd58a016f6f2a2&scope.system=all&role.id=4ae1af3c48274e43b0350210bf332e0d => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:47.259758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a681f0-8a50-4316-8ce7-c9b3b07f8935 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.260044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a681f0-8a50-4316-8ce7-c9b3b07f8935 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.260322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a681f0-8a50-4316-8ce7-c9b3b07f8935 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.275150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 149/308] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:47 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:47.278002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85af84-0e54-4aa3-8324-1500046e16c5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.278312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85af84-0e54-4aa3-8324-1500046e16c5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.278560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85af84-0e54-4aa3-8324-1500046e16c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.304637 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ab85af84-0e54-4aa3-8324-1500046e16c5 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:47.306247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ab85af84-0e54-4aa3-8324-1500046e16c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:47.311044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:47.332732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472ea3d-fabd-4429-b8a9-217570343d60 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.340046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:47.374419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.375524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.376589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.377118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.378440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:47.378978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:47.381247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:47.393601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 150/309] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:47.394386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 160/310] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:47.401684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85af84-0e54-4aa3-8324-1500046e16c5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:47.418942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:47.525331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85af84-0e54-4aa3-8324-1500046e16c5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.550195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d587f4-13c2-4125-bc02-e17cfc55262e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.573029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.574228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.574512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.575027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] PATH_INFO: `/v3/users/ff5ab9a2647e4bb5bc6f546748c8212f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.577398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] RBAC: Authorizing `identity:get_user(user_id=ff5ab9a2647e4bb5bc6f546748c8212f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:47.578870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:47.581675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 151/311] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:47 2022] GET /identity/v3/users/ff5ab9a2647e4bb5bc6f546748c8212f => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:47.587402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:47.598776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.599815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.600203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.600603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.614021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:47.620904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:47.623935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:47.624815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:47.625617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:47.628283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 161/312] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:47.634214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:47.641220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:47.699609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29914f-af9d-4fed-9c60-29d8ab65e0b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.751899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.753151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.753667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.754140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] PATH_INFO: `/v3/system/users/ff5ab9a2647e4bb5bc6f546748c8212f/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.755974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ff5ab9a2647e4bb5bc6f546748c8212f, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:47.757581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:47.768511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843af97-320a-4641-8027-c190c58a77d8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.806444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.807051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.807423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.807705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:47.808552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:47.808867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:47.810301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:47.820530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 162/313] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:47.826382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:47.860902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 152/314] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jul 18 06:03:47 2022] PUT /identity/v3/system/users/ff5ab9a2647e4bb5bc6f546748c8212f/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:47.912594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:47.954920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dde85d-276c-4f8f-867a-d20780b193e8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:47.996853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:47.998194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:47.998686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:47.999166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] PATH_INFO: `/v3/users/9dad64331b8c44dba1d7148342f99bea` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:48.000816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] RBAC: Authorizing `identity:get_user(user_id=9dad64331b8c44dba1d7148342f99bea)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:48.002696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:48.005020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 163/315] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:47 2022] GET /identity/v3/users/9dad64331b8c44dba1d7148342f99bea => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:48.011307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:48.124819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:48.127973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca793e-be7f-4392-b896-7ac59d33d623 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:48.165621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:48.166291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:48.166575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:48.166858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:48.243680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:48.245206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:48.345782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:48.352487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 153/316] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:48.358694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:48.469506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d16718e-efc2-4928-80ec-89e84cff43ff None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:48.508780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209214f-6546-4f2f-99a8-34ac17e32a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:48.509981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209214f-6546-4f2f-99a8-34ac17e32a73 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:48.510440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209214f-6546-4f2f-99a8-34ac17e32a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:48.510863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209214f-6546-4f2f-99a8-34ac17e32a73 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:48.512237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209214f-6546-4f2f-99a8-34ac17e32a73 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:48.513922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b209214f-6546-4f2f-99a8-34ac17e32a73 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:48.516264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 164/317] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:48 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:48.526133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:48.634985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29bc8c-b99d-412d-8a39-e1d26654efa0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:48.671882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2afd31-3734-4492-b49d-7312e950ac99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:48.672792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2afd31-3734-4492-b49d-7312e950ac99 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:48.673249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2afd31-3734-4492-b49d-7312e950ac99 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:48.673673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2afd31-3734-4492-b49d-7312e950ac99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:48.674665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2afd31-3734-4492-b49d-7312e950ac99 None admin] RBAC: Adding query filter params (role.id=4ae1af3c48274e43b0350210bf332e0d, scope.project.id=74d14621b0374c92b384d824a365386b, user.id=9dad64331b8c44dba1d7148342f99bea) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:48.675151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2afd31-3734-4492-b49d-7312e950ac99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:48.676765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2afd31-3734-4492-b49d-7312e950ac99 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:48.683978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 154/318] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:03:48 2022] GET /identity/v3/role_assignments?user.id=9dad64331b8c44dba1d7148342f99bea&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=4ae1af3c48274e43b0350210bf332e0d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:49.158232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad93a97-d268-497f-8e77-4bf6ec088c9e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.158755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad93a97-d268-497f-8e77-4bf6ec088c9e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.158869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad93a97-d268-497f-8e77-4bf6ec088c9e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.160374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 165/319] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:49.165898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc57c5-ceb1-44a7-895e-d5ac5ef644eb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.166377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc57c5-ceb1-44a7-895e-d5ac5ef644eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.166447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc57c5-ceb1-44a7-895e-d5ac5ef644eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.185944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-16fc57c5-ceb1-44a7-895e-d5ac5ef644eb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:49.187217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-16fc57c5-ceb1-44a7-895e-d5ac5ef644eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:49.247692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:49.262410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 155/320] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:49.285729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad93a97-d268-497f-8e77-4bf6ec088c9e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:49.288835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:49.413946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad93a97-d268-497f-8e77-4bf6ec088c9e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:49.450493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca9b79-d4b7-4a2f-af6d-d1403afb5f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:49.451846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca9b79-d4b7-4a2f-af6d-d1403afb5f9f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.452126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca9b79-d4b7-4a2f-af6d-d1403afb5f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.452401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca9b79-d4b7-4a2f-af6d-d1403afb5f9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.453660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca9b79-d4b7-4a2f-af6d-d1403afb5f9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:49.455128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca9b79-d4b7-4a2f-af6d-d1403afb5f9f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:49.457041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 166/321] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:03:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:49.462465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc57c5-ceb1-44a7-895e-d5ac5ef644eb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:49.468037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897724-ffda-4098-995d-e29d9966a19a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.468326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897724-ffda-4098-995d-e29d9966a19a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.468608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e897724-ffda-4098-995d-e29d9966a19a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.470182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 167/322] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:49.475537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870440b9-b815-4fe9-872d-a029f91c2a90 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.475836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870440b9-b815-4fe9-872d-a029f91c2a90 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.476154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870440b9-b815-4fe9-872d-a029f91c2a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.493204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-870440b9-b815-4fe9-872d-a029f91c2a90 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:49.494416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-870440b9-b815-4fe9-872d-a029f91c2a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:49.567335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:49.573266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 168/323] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:49.580590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc57c5-ceb1-44a7-895e-d5ac5ef644eb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:49.596739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870440b9-b815-4fe9-872d-a029f91c2a90 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:49.621548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:49.622220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.622504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.622780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] PATH_INFO: `/v3/groups` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.624192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:49.625679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:49.703833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870440b9-b815-4fe9-872d-a029f91c2a90 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:49.718685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 156/324] 10.222.0.27 () {60 vars in 1134 bytes} [Mon Jul 18 06:03:49 2022] POST /identity/v3/groups => generated 226 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:03:49.743961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:49.744812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.745145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.745459 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.758690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:49.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:49.767958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:49.768762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:49.773654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 169/325] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:49.775216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:49.837568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:49.896091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f4018-9e97-45db-baf0-4fc0e1b64c20 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:49.936111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec4b3e-f1ba-4179-8d50-25ceb2fd3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:49.936791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec4b3e-f1ba-4179-8d50-25ceb2fd3c14 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:49.937149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec4b3e-f1ba-4179-8d50-25ceb2fd3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:49.937429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec4b3e-f1ba-4179-8d50-25ceb2fd3c14 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:49.938194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec4b3e-f1ba-4179-8d50-25ceb2fd3c14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:49.938834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec4b3e-f1ba-4179-8d50-25ceb2fd3c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:49.939936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec4b3e-f1ba-4179-8d50-25ceb2fd3c14 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:49.949509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 157/326] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:49.956012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:50.028500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:50.056753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa348-abc9-4e53-b1db-c1a8025bda5c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:50.057091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa348-abc9-4e53-b1db-c1a8025bda5c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:50.057372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1aa348-abc9-4e53-b1db-c1a8025bda5c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:50.058831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 158/327] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:50.065171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17e1e-b11a-4b2b-a0ca-c47044860b7e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:50.065460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17e1e-b11a-4b2b-a0ca-c47044860b7e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:50.065739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca17e1e-b11a-4b2b-a0ca-c47044860b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:50.078835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fefb8-cd71-4682-b8f3-a42e58529506 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:50.087555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5ca17e1e-b11a-4b2b-a0ca-c47044860b7e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:50.089142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ca17e1e-b11a-4b2b-a0ca-c47044860b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:50.121885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:50.122774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:50.123598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:50.123879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] PATH_INFO: `/v3/users/4facc5fa54c744eaa1fd58a016f6f2a2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:50.125381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] RBAC: Authorizing `identity:get_user(user_id=4facc5fa54c744eaa1fd58a016f6f2a2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:50.126919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:50.128965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 170/328] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:49 2022] GET /identity/v3/users/4facc5fa54c744eaa1fd58a016f6f2a2 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:50.134637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:50.184031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 159/329] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:50.208264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17e1e-b11a-4b2b-a0ca-c47044860b7e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:50.260899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:50.270661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee492cd-03c4-4b73-9895-a8b56eeb08c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:50.317151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:50.327520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:50.328281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:50.328565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:50.328843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] PATH_INFO: `/v3/system/users/4facc5fa54c744eaa1fd58a016f6f2a2/roles/4ae1af3c48274e43b0350210bf332e0d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:50.330542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4facc5fa54c744eaa1fd58a016f6f2a2, role_id=4ae1af3c48274e43b0350210bf332e0d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:50.332434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:50.344753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca17e1e-b11a-4b2b-a0ca-c47044860b7e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:50.390010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:50.390873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:50.391155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:50.391425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:50.403531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:50.411800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:50.412732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:50.413644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 160/330] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:50.419472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:50.534444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90ed95-426e-43a6-baef-8319710af567 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:50.574924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:50.576010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:50.577152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:50.577647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:50.578628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:50.579162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:50.580773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:50.590482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 161/331] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:50.595800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:50.597074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:50.661415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 171/332] 10.222.0.27 () {58 vars in 1334 bytes} [Mon Jul 18 06:03:50 2022] PUT /identity/v3/system/users/4facc5fa54c744eaa1fd58a016f6f2a2/roles/4ae1af3c48274e43b0350210bf332e0d => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:50.749298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b72dd-6038-4c81-8c74-5d46dd16a816 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:50.803167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622d920-5445-4c91-b516-e2322ad4260d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:50.804309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622d920-5445-4c91-b516-e2322ad4260d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:50.804594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622d920-5445-4c91-b516-e2322ad4260d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:50.804872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622d920-5445-4c91-b516-e2322ad4260d None admin] PATH_INFO: `/v3/users/ff5ab9a2647e4bb5bc6f546748c8212f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:50.806403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622d920-5445-4c91-b516-e2322ad4260d None admin] RBAC: Authorizing `identity:get_user(user_id=ff5ab9a2647e4bb5bc6f546748c8212f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:50.807947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622d920-5445-4c91-b516-e2322ad4260d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:50.810171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 162/333] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:50 2022] GET /identity/v3/users/ff5ab9a2647e4bb5bc6f546748c8212f => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:50.817383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:50.956834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4dd17-c5d1-4a4b-b1d1-8c74e97bafdc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:51.000231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8fa73-ea0f-4d09-b45f-0bb07bff5c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:51.000903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8fa73-ea0f-4d09-b45f-0bb07bff5c51 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:51.001216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8fa73-ea0f-4d09-b45f-0bb07bff5c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:51.001490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8fa73-ea0f-4d09-b45f-0bb07bff5c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:51.002337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8fa73-ea0f-4d09-b45f-0bb07bff5c51 None admin] RBAC: Adding query filter params (role.id=82e9eb17bbd04cf888953955a1c648af, user.id=ff5ab9a2647e4bb5bc6f546748c8212f, scope.system=all) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:51.002650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8fa73-ea0f-4d09-b45f-0bb07bff5c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:51.004127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8fa73-ea0f-4d09-b45f-0bb07bff5c51 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:51.022186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 172/334] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 18 06:03:50 2022] GET /identity/v3/role_assignments?user.id=ff5ab9a2647e4bb5bc6f546748c8212f&scope.system=all&role.id=82e9eb17bbd04cf888953955a1c648af => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:52.507240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94491-e2cf-4d28-b07e-fa3d9d4b5f24 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:52.508639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94491-e2cf-4d28-b07e-fa3d9d4b5f24 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:52.509386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94491-e2cf-4d28-b07e-fa3d9d4b5f24 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:52.512529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 163/335] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:52.523563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce36fc-a890-4a79-be7b-2d20a17fbc51 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:52.525077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce36fc-a890-4a79-be7b-2d20a17fbc51 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:52.525844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce36fc-a890-4a79-be7b-2d20a17fbc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:52.564907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-54ce36fc-a890-4a79-be7b-2d20a17fbc51 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:52.567512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-54ce36fc-a890-4a79-be7b-2d20a17fbc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:52.580430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642fd4-97ca-4251-8a6d-66299a3c221f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:52.580882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642fd4-97ca-4251-8a6d-66299a3c221f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:52.581380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642fd4-97ca-4251-8a6d-66299a3c221f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:52.587813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 164/336] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:52.592608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733621a8-b87c-4d3f-b2f2-abca5e217244 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:52.592608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733621a8-b87c-4d3f-b2f2-abca5e217244 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:52.592608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733621a8-b87c-4d3f-b2f2-abca5e217244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:52.619466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-733621a8-b87c-4d3f-b2f2-abca5e217244 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:52.620693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-733621a8-b87c-4d3f-b2f2-abca5e217244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:52.661552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:52.727986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:52.751933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 165/337] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:52.785289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 173/338] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:52.788088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733621a8-b87c-4d3f-b2f2-abca5e217244 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:52.822418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce36fc-a890-4a79-be7b-2d20a17fbc51 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:53.015900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733621a8-b87c-4d3f-b2f2-abca5e217244 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:53.080194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce36fc-a890-4a79-be7b-2d20a17fbc51 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:53.102790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:53.103624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:53.103912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:53.104189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:53.122724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:53.135884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:53.136821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:53.137617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 166/339] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:53.143526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:53.175603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:53.175969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:53.177079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:53.177389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:53.177695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:53.212256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:53.220926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:53.221902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:53.222681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:53.226755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 174/340] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:03:53.238033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:53.293554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca77902-4fc1-42a0-a91e-78bf81cb4e58 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:53.345165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:53.345766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:53.346058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:53.346341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:53.347110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:53.347424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:53.348809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:53.350397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:53.363884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 167/341] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:53.369439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:53.496013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df13a0-407d-46aa-a0d8-9ff2e846e971 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:53.507394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:53.536602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52caddd-2ace-4f30-899b-9487000d482b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:53.596713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:53.596967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:53.597678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:53.597806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:53.597887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:53.597963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:53.598036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:53.598116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:53.598627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:53.598939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:53.600346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:53.612942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 175/342] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:53.625447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:53.705337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:53.713065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:53.820271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f5f9c-7ecd-47bd-906d-c387c8b00ee1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:53.822256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:53.833358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:53.877129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 168/343] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:03:53.881835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d59149a-3f8d-459b-af32-9057e0c83539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:53.882272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:53.882532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59149a-3f8d-459b-af32-9057e0c83539 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:53.882825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59149a-3f8d-459b-af32-9057e0c83539 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:53.883110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d59149a-3f8d-459b-af32-9057e0c83539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:53.993920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59149a-3f8d-459b-af32-9057e0c83539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:53.996788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d59149a-3f8d-459b-af32-9057e0c83539 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:54.118063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5981f20-ec6b-4a7f-af72-fca860b968c9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:54.173840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:54.174736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.175017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.175292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.176681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:54.178227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:54.180641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 169/344] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:53 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:54.193541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:54.266469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 176/345] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:54.273040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:54.274377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef80ce-5c0d-4b90-8493-e2126a4f9064 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.275101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef80ce-5c0d-4b90-8493-e2126a4f9064 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.275804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef80ce-5c0d-4b90-8493-e2126a4f9064 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.278324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 177/346] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:54.279393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef80ce-5c0d-4b90-8493-e2126a4f9064 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:54.289373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:54.354584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb62814-0387-4add-a0f7-57e7c4fcf6ca None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:54.464624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f08b5-9e31-48d4-93a5-1eede578e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:54.465454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f08b5-9e31-48d4-93a5-1eede578e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.465737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f08b5-9e31-48d4-93a5-1eede578e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.466016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f08b5-9e31-48d4-93a5-1eede578e0e0 None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.482469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f08b5-9e31-48d4-93a5-1eede578e0e0 None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:54.483984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f08b5-9e31-48d4-93a5-1eede578e0e0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:54.486135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 170/347] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:03:54 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:54.487409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f244-1ef0-4bf4-8013-002761a14219 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.487698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f244-1ef0-4bf4-8013-002761a14219 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.487977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934f244-1ef0-4bf4-8013-002761a14219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.515381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6934f244-1ef0-4bf4-8013-002761a14219 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:54.516611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6934f244-1ef0-4bf4-8013-002761a14219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:54.518140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef80ce-5c0d-4b90-8493-e2126a4f9064 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:54.569489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:54.571077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.571375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.571683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.573987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:54.575524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:54.578636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 178/348] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:54 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:54.579265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:54.604218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 171/349] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:54.605697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85cab8-0135-43c8-94cc-3289f24de506 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.606135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85cab8-0135-43c8-94cc-3289f24de506 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.606555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85cab8-0135-43c8-94cc-3289f24de506 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.608329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 172/350] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:54.609594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a32d-70d6-4ea1-bd25-3d50bace9b2c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.610025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a32d-70d6-4ea1-bd25-3d50bace9b2c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.610539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88a32d-70d6-4ea1-bd25-3d50bace9b2c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.618197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 173/351] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:54.619774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88a32d-70d6-4ea1-bd25-3d50bace9b2c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:54.680708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:54.698266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:54.723528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff9bf4-7dd9-4e63-978b-f5b389509851 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:54.794613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b65df-36e1-4f33-872b-22b022bdf9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:54.796261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b65df-36e1-4f33-872b-22b022bdf9de None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.796731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b65df-36e1-4f33-872b-22b022bdf9de None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.797218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b65df-36e1-4f33-872b-22b022bdf9de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.798671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b65df-36e1-4f33-872b-22b022bdf9de None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=45afb887c4d943998202e1bc7943bb06) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:54.799290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b65df-36e1-4f33-872b-22b022bdf9de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:54.801563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b65df-36e1-4f33-872b-22b022bdf9de None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:54.805045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88a32d-70d6-4ea1-bd25-3d50bace9b2c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:54.813767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 179/352] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:03:54 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=e5e16600844f49db892c00085568f6e8 => generated 260 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:54.815930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25997bb-e438-485e-80e1-067afb3321d3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.816428 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25997bb-e438-485e-80e1-067afb3321d3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.816907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25997bb-e438-485e-80e1-067afb3321d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.840159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c25997bb-e438-485e-80e1-067afb3321d3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:54.842266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c25997bb-e438-485e-80e1-067afb3321d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:54.849348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00419dbc-5f29-4eec-b74a-5b20038aa439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:54.850285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419dbc-5f29-4eec-b74a-5b20038aa439 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.850572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419dbc-5f29-4eec-b74a-5b20038aa439 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.850847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00419dbc-5f29-4eec-b74a-5b20038aa439 None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.852735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00419dbc-5f29-4eec-b74a-5b20038aa439 None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:54.854376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00419dbc-5f29-4eec-b74a-5b20038aa439 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:54.856182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 174/353] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:03:54 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:54.857637 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7ea1-e52d-4f7b-be23-ea35d83f9609 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.857992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7ea1-e52d-4f7b-be23-ea35d83f9609 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.858272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7ea1-e52d-4f7b-be23-ea35d83f9609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.878271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-432e7ea1-e52d-4f7b-be23-ea35d83f9609 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:54.879946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-432e7ea1-e52d-4f7b-be23-ea35d83f9609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:54.942476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 180/354] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:54.943731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25997bb-e438-485e-80e1-067afb3321d3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:54.987873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 175/355] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:54.989341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47e66-2fca-43a7-8200-4880391fabae None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:54.989636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47e66-2fca-43a7-8200-4880391fabae None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:54.989921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec47e66-2fca-43a7-8200-4880391fabae None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:54.992511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 176/356] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:54.993703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec47e66-2fca-43a7-8200-4880391fabae None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.032346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:55.055994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:55.084907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25997bb-e438-485e-80e1-067afb3321d3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.141823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec47e66-2fca-43a7-8200-4880391fabae None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.148477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:55.149358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.149649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.149931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.164866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:55.177522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:55.178523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:55.179614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:55.185027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 181/357] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:55.185027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.201734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef13a2-3ae9-4983-99fd-823c2a9ccdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:55.202794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef13a2-3ae9-4983-99fd-823c2a9ccdba None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.203238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef13a2-3ae9-4983-99fd-823c2a9ccdba None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.203675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef13a2-3ae9-4983-99fd-823c2a9ccdba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.204681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef13a2-3ae9-4983-99fd-823c2a9ccdba None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=45afb887c4d943998202e1bc7943bb06) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:55.205033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef13a2-3ae9-4983-99fd-823c2a9ccdba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:55.206507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef13a2-3ae9-4983-99fd-823c2a9ccdba None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:55.216700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 177/358] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:03:54 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=82e9eb17bbd04cf888953955a1c648af => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:55.216700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6060-679f-4f99-b1fe-b1a72c400384 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.216700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6060-679f-4f99-b1fe-b1a72c400384 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.216700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be6060-679f-4f99-b1fe-b1a72c400384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.234964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-61be6060-679f-4f99-b1fe-b1a72c400384 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:55.236272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-61be6060-679f-4f99-b1fe-b1a72c400384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:55.319875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808b102-e4f3-426e-acc7-e9be59c259ca None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.351678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:55.368273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:55.371633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.371633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.371633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.374815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 178/359] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:55.375755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be6060-679f-4f99-b1fe-b1a72c400384 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.386072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:55.397380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:55.398443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:55.399353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:55.401858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 182/360] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:55.403014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.444206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:55.542123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d174a3-9432-41f0-87b3-9005de9ff526 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.547429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be6060-679f-4f99-b1fe-b1a72c400384 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.594778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:55.595400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.595708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.595991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.596782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:55.597140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:55.597838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:55.598648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:55.598766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.598938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.599200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.610641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 183/361] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:55.611895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.621059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:55.631459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:55.632439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:55.633262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 179/362] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:55.634544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.674549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:55.739040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe708dac-25bb-4818-a67b-7b44a0aebd43 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.760425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:55.769430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef603b2c-5e84-45e9-9042-e78bd961db95 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.807837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:55.809080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.809603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.810282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.811801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:55.811919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:55.812466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:55.812636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:55.812914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:55.813234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:55.814685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:55.825307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:55.830320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 184/363] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:55.831513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:55.834575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:55.835500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:55.836276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 180/364] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:03:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:55.836944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:55.963870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3162af9-08df-4ca8-aa0c-4e40a68e742d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.969052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feac542-30cc-4535-994e-097f3d22a805 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:55.978999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:56.008270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.009271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.009885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.009885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.009885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.010237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.013195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.013195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.013195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:56.013195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.013928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.026162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 181/365] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:56.027100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:56.052399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:56.091695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.093406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.148453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48350df0-ace9-4451-b6a0-f15833ca8786 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:56.189298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.190070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.190360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.190637 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.213357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 185/366] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:56.213842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:56.224733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:56.287123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.288783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.322279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:56.332723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dafde-884e-4d47-a247-9a80884bd4c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:56.383162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.384230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.384912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.385449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.386457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:56.386988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.389481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.403546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 186/367] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:56.404828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:56.441889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 182/368] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:56.442786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:56.489091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:56.530499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217af7cc-2798-47f7-a57c-78ed899e5a49 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:56.578246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.579152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.580018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.580305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] PATH_INFO: `/v3/users/4facc5fa54c744eaa1fd58a016f6f2a2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.582643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] RBAC: Authorizing `identity:get_user(user_id=4facc5fa54c744eaa1fd58a016f6f2a2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.584402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.586434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 187/369] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:03:56 2022] GET /identity/v3/users/4facc5fa54c744eaa1fd58a016f6f2a2 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:56.587711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:56.618185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984529b-1151-4beb-98f1-f9ce43d1e200 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:56.655423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:56.690700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.691642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.691932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.692214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.693704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.695399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.697533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 183/370] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:56 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:56.698458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:56.738559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4422e5b9-0b30-4854-96f2-dec80450ec77 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:56.785853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.786567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.786839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.787118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.813014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:56.820692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfee64a2-912f-49bb-a746-b09c56ba9afd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:56.889066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.890587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.891001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:56.893048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:56.894024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:56.894884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:56.897541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:56.900755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:56.908413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 184/371] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:56 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:56.910471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.022004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:57.048967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 188/372] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:03:57.048967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.118062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312632e-6c36-48bb-aecf-07c34e6e1010 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.128050 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:57.167580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.169542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.170096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.170644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.171772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] RBAC: Adding query filter params (role.id=4ae1af3c48274e43b0350210bf332e0d, user.id=4facc5fa54c744eaa1fd58a016f6f2a2, scope.system=all) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:57.172288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.174665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.195157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 185/373] 10.222.0.27 () {56 vars in 1308 bytes} [Mon Jul 18 06:03:56 2022] GET /identity/v3/role_assignments?user.id=4facc5fa54c744eaa1fd58a016f6f2a2&scope.system=all&role.id=4ae1af3c48274e43b0350210bf332e0d => generated 510 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:57.195901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.213530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2499e-8f6a-47d6-90c1-9db018f08d10 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.255334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.256247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.256536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.256886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.258304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.259833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.261668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 189/374] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:03:57 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:57.262486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.386784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515efbdc-5ed1-46e5-90f0-e9fc45331210 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.396792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:57.436937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.438471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.438471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.438471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] PATH_INFO: `/v3/projects/8a3405aadfe54be0a4fabaa1726d8751` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.440789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3405aadfe54be0a4fabaa1726d8751)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.442792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.444946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 190/375] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:57 2022] GET /identity/v3/projects/8a3405aadfe54be0a4fabaa1726d8751 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:57.445755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d890fa-27b6-4bf5-9898-48602c9c6267 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.445877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.467919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:57.496299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.497205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.497489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.497801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.500329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.502213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.504265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 186/376] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:03:57 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:57.505094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.586284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409ef0b-2ced-4fab-b4d0-2678e4601b66 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.645332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.646417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.646888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.647369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.648429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=74d14621b0374c92b384d824a365386b) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:57.648949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.650253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8524dc-eaa4-4caa-88cd-063c5ea16332 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.651144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.658905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 191/377] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:03:57 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=82e9eb17bbd04cf888953955a1c648af => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:57.660025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.698597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69832c9a-7dd8-4ded-ab5f-ddce33d410cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.699729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832c9a-7dd8-4ded-ab5f-ddce33d410cd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.699925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832c9a-7dd8-4ded-ab5f-ddce33d410cd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.700146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832c9a-7dd8-4ded-ab5f-ddce33d410cd None admin] PATH_INFO: `/v3/groups/db7e02dd74f341c0b7ac16005be6d45c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.707930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69832c9a-7dd8-4ded-ab5f-ddce33d410cd None admin] RBAC: Authorizing `identity:get_group(group_id=db7e02dd74f341c0b7ac16005be6d45c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.709536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69832c9a-7dd8-4ded-ab5f-ddce33d410cd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.711462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 187/378] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:03:57 2022] GET /identity/v3/groups/db7e02dd74f341c0b7ac16005be6d45c => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:57.712657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c32a-2881-46bb-aca8-2fd073fea841 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.712952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c32a-2881-46bb-aca8-2fd073fea841 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.718434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0c32a-2881-46bb-aca8-2fd073fea841 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.720128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 188/379] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:57.720687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:57.720797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c32a-2881-46bb-aca8-2fd073fea841 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:57.782033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:57.794150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1da25e-01a8-46df-b281-333c22a04883 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.847886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b8e650-e27a-4a88-9a84-938c5bf1b4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.849465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e650-e27a-4a88-9a84-938c5bf1b4dd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.850197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e650-e27a-4a88-9a84-938c5bf1b4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.850929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b8e650-e27a-4a88-9a84-938c5bf1b4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.852660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8e650-e27a-4a88-9a84-938c5bf1b4dd None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=74d14621b0374c92b384d824a365386b) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:57.853444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8e650-e27a-4a88-9a84-938c5bf1b4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.855782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b8e650-e27a-4a88-9a84-938c5bf1b4dd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.856012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0c32a-2881-46bb-aca8-2fd073fea841 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:57.865823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 192/380] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:03:57 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=e5e16600844f49db892c00085568f6e8 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:57.868379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbb66-f737-4211-ace9-c6e4825ec9c2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.869282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbb66-f737-4211-ace9-c6e4825ec9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.870007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903dbb66-f737-4211-ace9-c6e4825ec9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.900458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-903dbb66-f737-4211-ace9-c6e4825ec9c2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:57.902930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-903dbb66-f737-4211-ace9-c6e4825ec9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:57.918255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:57.919495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:57.920638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:57.921272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:57.922931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] RBAC: Adding query filter params (group.id=db7e02dd74f341c0b7ac16005be6d45c, role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=8a3405aadfe54be0a4fabaa1726d8751) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:57.923581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:57.926292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:57.941183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 189/381] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:03:57 2022] GET /identity/v3/role_assignments?group.id=db7e02dd74f341c0b7ac16005be6d45c&scope.project.id=8a3405aadfe54be0a4fabaa1726d8751&role.id=a30b539353cf42d08ab504edac924aa8 => generated 260 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:58.036856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 193/382] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:03:58.077777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:58.211499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53b8f1-feb6-4ffc-99d7-bd8ccd888823 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:58.211833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53b8f1-feb6-4ffc-99d7-bd8ccd888823 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:58.212065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53b8f1-feb6-4ffc-99d7-bd8ccd888823 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:58.215107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 194/383] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:03:58.221322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f082ad-0e11-4e6c-9d6d-9f7e7756bf6e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:58.221617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f082ad-0e11-4e6c-9d6d-9f7e7756bf6e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:58.221891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f082ad-0e11-4e6c-9d6d-9f7e7756bf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:58.246189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63cfb43-e413-462e-949e-79078ed72f27 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:58.256992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:58.258583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-90f082ad-0e11-4e6c-9d6d-9f7e7756bf6e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:03:58.259807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-90f082ad-0e11-4e6c-9d6d-9f7e7756bf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:03:58.285273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:58.286098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:58.286385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:58.286665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:58.309659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:58.319008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:58.319950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:03:58.320715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 190/384] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:03:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:58.326921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:58.339184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:58.440565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2a8be-a0ba-4f72-9ede-0c442a666de7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:58.459387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 195/385] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:03:58.479478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:58.480116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:58.480406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:58.480689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:58.481498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:58.481950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:58.483425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:58.489665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f082ad-0e11-4e6c-9d6d-9f7e7756bf6e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:58.493997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 191/386] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:03:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:58.500164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:58.542251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:58.666418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0fba14-b8a9-4d4e-af22-4976f87f1e47 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:58.716044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:58.718425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:58.718708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:58.718988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:58.722484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:58.724229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:58.725974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 192/387] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:03:58 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:58.731811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:58.767206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f082ad-0e11-4e6c-9d6d-9f7e7756bf6e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:58.849365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:58.853671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae5500-768d-4ec4-98ca-e347e21b266a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:58.862704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:58.863529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:58.865730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:58.865730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:58.880824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:03:58.894744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:58.895618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:58.895900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:58.896179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:58.897418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:03:58.897599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:03:58.899589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:03:58.901635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 196/388] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:03:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:03:58.903193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:58.903193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 193/389] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:58 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:03:58.906747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:58.910149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:58.951678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:59.030709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b668c223-6704-4a71-89bf-dbb1ecf959e3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:59.071558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:59.072441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:59.072716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:59.073003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06/groups/c1be7caa193b414683d08a441821a05a/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:59.077457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] RBAC: Authorizing `identity:create_grant(project_id=45afb887c4d943998202e1bc7943bb06, group_id=c1be7caa193b414683d08a441821a05a, role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:59.079234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:59.137446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eeb3d5-16ca-4688-8bf8-378ddaaca643 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:59.167103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 194/390] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 18 06:03:58 2022] PUT /identity/v3/projects/45afb887c4d943998202e1bc7943bb06/groups/c1be7caa193b414683d08a441821a05a/roles/e5e16600844f49db892c00085568f6e8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:03:59.190780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:59.191476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:59.191757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:59.192037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:59.192891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:03:59.193233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:59.194878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:59.207110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 197/391] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:03:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:59.214058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:59.248655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:59.361438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc43b-f285-4b20-bb85-b1e978706aed None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:59.416667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:59.417674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:59.417956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:59.418236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:59.419740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:59.422083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:59.424134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 195/392] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:03:59 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:59.429820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:59.542170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:59.564884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493040f-c52c-4bf3-b209-f85fc50ba9f3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:59.612783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5043471-6303-45a0-acec-e9b8c852c841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:59.613720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043471-6303-45a0-acec-e9b8c852c841 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:59.614003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043471-6303-45a0-acec-e9b8c852c841 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:59.614282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5043471-6303-45a0-acec-e9b8c852c841 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:59.616667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5043471-6303-45a0-acec-e9b8c852c841 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:59.618392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5043471-6303-45a0-acec-e9b8c852c841 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:59.620568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 198/393] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:03:59 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:03:59.626304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:03:59.756057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:03:59.763969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16dfc4-586d-4047-9c04-6b14e77bc1b9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:03:59.805088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d466454-fb10-4d2f-bf97-b66ddfdfa85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:03:59.805975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466454-fb10-4d2f-bf97-b66ddfdfa85b None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:03:59.806257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466454-fb10-4d2f-bf97-b66ddfdfa85b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:03:59.806574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d466454-fb10-4d2f-bf97-b66ddfdfa85b None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06/groups/c1be7caa193b414683d08a441821a05a/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:03:59.809651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466454-fb10-4d2f-bf97-b66ddfdfa85b None admin] RBAC: Authorizing `identity:create_grant(project_id=45afb887c4d943998202e1bc7943bb06, group_id=c1be7caa193b414683d08a441821a05a, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:03:59.811829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d466454-fb10-4d2f-bf97-b66ddfdfa85b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:03:59.929467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 196/394] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 18 06:03:59 2022] PUT /identity/v3/projects/45afb887c4d943998202e1bc7943bb06/groups/c1be7caa193b414683d08a441821a05a/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:00.184964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932c4e6-e1df-4355-94d0-998fed6246e1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.184964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932c4e6-e1df-4355-94d0-998fed6246e1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.184964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932c4e6-e1df-4355-94d0-998fed6246e1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.184964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 199/395] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:00.194351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5197-98cf-461a-8767-a12c9a1a8667 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.194351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5197-98cf-461a-8767-a12c9a1a8667 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.194351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced5197-98cf-461a-8767-a12c9a1a8667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.212330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-eced5197-98cf-461a-8767-a12c9a1a8667 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:00.213954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eced5197-98cf-461a-8767-a12c9a1a8667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:00.288506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 197/396] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:00.312956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932c4e6-e1df-4355-94d0-998fed6246e1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:00.453212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932c4e6-e1df-4355-94d0-998fed6246e1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:00.483036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865111fd-056b-4c16-8736-eb122a4af28a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.483359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865111fd-056b-4c16-8736-eb122a4af28a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.483611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865111fd-056b-4c16-8736-eb122a4af28a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.485578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 198/397] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:00.499463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ed1f-25a2-4569-9ca0-4efc6ed49664 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.500072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ed1f-25a2-4569-9ca0-4efc6ed49664 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.500249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:00.500736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2ed1f-25a2-4569-9ca0-4efc6ed49664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.501067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.501358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.501638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.525327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:00.538489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-91a2ed1f-25a2-4569-9ca0-4efc6ed49664 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:00.539696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-91a2ed1f-25a2-4569-9ca0-4efc6ed49664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:00.541713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:00.542570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:04:00.543360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:00.549488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 200/398] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:00.552203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:00.581911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:00.698059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 199/399] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:00.719548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b271083-66f1-4c82-ab19-808105cbdc72 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:00.741521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ed1f-25a2-4569-9ca0-4efc6ed49664 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:00.759755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:00.765402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511490f-65ef-42a0-94be-82d81ac2f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:00.766087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511490f-65ef-42a0-94be-82d81ac2f274 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.766381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511490f-65ef-42a0-94be-82d81ac2f274 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.766662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511490f-65ef-42a0-94be-82d81ac2f274 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.767932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511490f-65ef-42a0-94be-82d81ac2f274 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:00.768252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511490f-65ef-42a0-94be-82d81ac2f274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:00.769944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511490f-65ef-42a0-94be-82d81ac2f274 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:00.782566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 201/400] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:04:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:00.783911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45c764-8bdd-438f-a84e-cc47de6a6732 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.784207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45c764-8bdd-438f-a84e-cc47de6a6732 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.784487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f45c764-8bdd-438f-a84e-cc47de6a6732 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.785922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 202/401] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:00.790765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45c764-8bdd-438f-a84e-cc47de6a6732 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:00.876599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2ed1f-25a2-4569-9ca0-4efc6ed49664 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:00.881156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:00.916438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b50dff-0d81-42b8-bbbb-d5945e1d05f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:00.917606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50dff-0d81-42b8-bbbb-d5945e1d05f6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.917716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f45c764-8bdd-438f-a84e-cc47de6a6732 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:00.917898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50dff-0d81-42b8-bbbb-d5945e1d05f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.918177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b50dff-0d81-42b8-bbbb-d5945e1d05f6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.938501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b50dff-0d81-42b8-bbbb-d5945e1d05f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e9b50dff-0d81-42b8-bbbb-d5945e1d05f6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:00.949589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:00.950514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:00.952083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:00.953289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 200/402] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:00.956155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f15c1-a9f2-44d3-af76-9a23df2eeee3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.956155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f15c1-a9f2-44d3-af76-9a23df2eeee3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.956155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654f15c1-a9f2-44d3-af76-9a23df2eeee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.961121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:00.962542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:00.962542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:00.962734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:00.963860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:00.965340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:00.967150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 203/403] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:00 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:00.967930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:00.974782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-654f15c1-a9f2-44d3-af76-9a23df2eeee3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:00.977424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-654f15c1-a9f2-44d3-af76-9a23df2eeee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:01.056864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 201/404] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:01.062860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f15c1-a9f2-44d3-af76-9a23df2eeee3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.063596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:01.114663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e0cc6d-10e9-4b9b-8517-781a9b867e5e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.152451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.153162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.153451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.153735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.155034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:01.155373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:01.157163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:01.166098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 204/405] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:01.166983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.176971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:01.198945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654f15c1-a9f2-44d3-af76-9a23df2eeee3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.247068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.247910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.248200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.248504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.249766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:01.251207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:01.253100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 202/406] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:01 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:01.253708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.305705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1721666f-5110-4dad-af5e-ac02d3706790 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.341059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:01.352547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.354200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.354636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.356474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.370520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:01.373835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a3b97-3333-43af-9dfd-9a142db17f2d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:01.380583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:01.381496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:01.382284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:01.390046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 205/407] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:01.391218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.418523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.419413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.420219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.420620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.422258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:01.423781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:01.425838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 203/408] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:01 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:01.426661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.476430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:01.517483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be7e19c-daf0-47ab-a83d-03230f7cf32d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.549214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13319a83-a390-41f0-ac55-b8cd0ed4450b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.553501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.554930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.555404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.555856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b/groups/c1be7caa193b414683d08a441821a05a/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.558091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=74d14621b0374c92b384d824a365386b, group_id=c1be7caa193b414683d08a441821a05a, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:01.559763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:01.587237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.587901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.588184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.588459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.589290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:01.589598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:01.590965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:01.605130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 204/409] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:01.605130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.607795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:01.677020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 206/410] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 18 06:04:01 2022] PUT /identity/v3/projects/74d14621b0374c92b384d824a365386b/groups/c1be7caa193b414683d08a441821a05a/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:01.677020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.788689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b33b7-3056-4d21-92b1-6c085c24817e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.882305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53e872-79d7-4522-8bfa-0a0cba1dbbe4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:01.882869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.883856 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.884245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.884676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.887816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:01.890137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:01.892755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 205/411] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:01 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:01.898034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.913199 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:01.926243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:01.927458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:01.927990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:01.928511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] PATH_INFO: `/v3/groups/db7e02dd74f341c0b7ac16005be6d45c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:01.930156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] RBAC: Authorizing `identity:get_group(group_id=db7e02dd74f341c0b7ac16005be6d45c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:01.931951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:01.934358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 207/412] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:01 2022] GET /identity/v3/groups/db7e02dd74f341c0b7ac16005be6d45c => generated 229 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:01.940547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:01.978355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:02.011150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7883fb5-8e40-47f8-bd03-406d3facd948 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:02.049484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60b67c-663e-47d6-93b3-88c742597a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:02.050449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b67c-663e-47d6-93b3-88c742597a75 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.051130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b67c-663e-47d6-93b3-88c742597a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.051130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60b67c-663e-47d6-93b3-88c742597a75 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b/groups/c1be7caa193b414683d08a441821a05a/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.053680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b67c-663e-47d6-93b3-88c742597a75 None admin] RBAC: Authorizing `identity:create_grant(project_id=74d14621b0374c92b384d824a365386b, group_id=c1be7caa193b414683d08a441821a05a, role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:02.055454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60b67c-663e-47d6-93b3-88c742597a75 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:02.058062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6dbce8-f89d-406b-aece-dc3b00bcb9ae None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:02.095907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49ef44-b67e-427b-94fa-7be09ed6c264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:02.097079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ef44-b67e-427b-94fa-7be09ed6c264 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.097508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ef44-b67e-427b-94fa-7be09ed6c264 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.097928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49ef44-b67e-427b-94fa-7be09ed6c264 None admin] PATH_INFO: `/v3/projects/8a3405aadfe54be0a4fabaa1726d8751` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.099275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ef44-b67e-427b-94fa-7be09ed6c264 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3405aadfe54be0a4fabaa1726d8751)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:02.100878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49ef44-b67e-427b-94fa-7be09ed6c264 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:02.103294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 208/413] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:01 2022] GET /identity/v3/projects/8a3405aadfe54be0a4fabaa1726d8751 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:02.104786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd91d8-4a30-4e1a-a867-aebaf6c7378f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.105235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd91d8-4a30-4e1a-a867-aebaf6c7378f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.105641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd91d8-4a30-4e1a-a867-aebaf6c7378f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.111415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 209/414] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:02.111415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd91d8-4a30-4e1a-a867-aebaf6c7378f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:02.148094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 206/415] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 18 06:04:01 2022] PUT /identity/v3/projects/74d14621b0374c92b384d824a365386b/groups/c1be7caa193b414683d08a441821a05a/roles/e5e16600844f49db892c00085568f6e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:04:02.150345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0be3-0e63-4b5e-9222-6f40b8f0cacf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.150864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0be3-0e63-4b5e-9222-6f40b8f0cacf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.151391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c0be3-0e63-4b5e-9222-6f40b8f0cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.182587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-083c0be3-0e63-4b5e-9222-6f40b8f0cacf None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:02.183838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-083c0be3-0e63-4b5e-9222-6f40b8f0cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:02.224150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:02.306404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd91d8-4a30-4e1a-a867-aebaf6c7378f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:02.352245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 207/416] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:02.375838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d279ba-f1b4-43c2-87fe-88724b7ec440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:02.377242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d279ba-f1b4-43c2-87fe-88724b7ec440 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.377730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d279ba-f1b4-43c2-87fe-88724b7ec440 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.378208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d279ba-f1b4-43c2-87fe-88724b7ec440 None admin] PATH_INFO: `/v3/projects/8a3405aadfe54be0a4fabaa1726d8751/groups/db7e02dd74f341c0b7ac16005be6d45c/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.380463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d279ba-f1b4-43c2-87fe-88724b7ec440 None admin] RBAC: Authorizing `identity:create_grant(project_id=8a3405aadfe54be0a4fabaa1726d8751, group_id=db7e02dd74f341c0b7ac16005be6d45c, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:02.382300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d279ba-f1b4-43c2-87fe-88724b7ec440 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:02.383666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0be3-0e63-4b5e-9222-6f40b8f0cacf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:02.450387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:02.481222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 210/417] 10.222.0.27 () {58 vars in 1442 bytes} [Mon Jul 18 06:04:02 2022] PUT /identity/v3/projects/8a3405aadfe54be0a4fabaa1726d8751/groups/db7e02dd74f341c0b7ac16005be6d45c/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:02.483266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d60a8-df17-4eab-8078-062185d67ce5 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.483616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d60a8-df17-4eab-8078-062185d67ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.483958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d60a8-df17-4eab-8078-062185d67ce5 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.485941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 211/418] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:02.491864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ff19-7563-4ed3-885c-2383e56bf17a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.492403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ff19-7563-4ed3-885c-2383e56bf17a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.492833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d49ff19-7563-4ed3-885c-2383e56bf17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.508964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c0be3-0e63-4b5e-9222-6f40b8f0cacf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:02.534212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1d49ff19-7563-4ed3-885c-2383e56bf17a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:02.535750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1d49ff19-7563-4ed3-885c-2383e56bf17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:02.558171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:02.559237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.559665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.560081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.584081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:02.593751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:02.594906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:02.595974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:02.606679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 208/419] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:02.611975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:02.672128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 212/420] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:02.693117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ff19-7563-4ed3-885c-2383e56bf17a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:02.756618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b688cd50-e935-4ade-86c1-e5810a98e120 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:02.759806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:02.782281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:02.801185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:02.801884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.802146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.802426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.803313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:02.803626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:02.805345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:02.816319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 209/421] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:02.826085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:02.834470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d49ff19-7563-4ed3-885c-2383e56bf17a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:02.892373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:02.893270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:02.893555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:02.894011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:02.917748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:02.930483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:02.931641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:04:02.932448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:02.935256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 213/422] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:02.941047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:03.046092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baedfb1-396e-42b2-a862-f2cc370f29ba None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:03.066285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e22057b-6d3d-44a8-8ddc-15f835d6f939 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:03.078600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:03.095710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:03.099951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:03.099951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:03.099951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:03.117913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:03.118604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:03.118888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:03.119163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:03.119923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] RBAC: Adding query filter params (name=member) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:03.120228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:03.121719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:03.140871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 214/423] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:04:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:03.146768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:03.156165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:03.177389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:03.178868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:03.339489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c21b2a-686b-4e6b-88f1-26c001296446 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:03.371501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 210/424] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:03.377712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:03.415770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:03.416430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:03.416718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:03.417024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:03.471671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:03.522760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:03.524224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:03.531289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:03.551640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3123b-e5e6-4655-a2e7-d650bc043f16 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:03.592225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:03.593547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:03.594048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:03.594549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:03.596229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:03.598030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:03.600620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 211/425] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:03 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:03.609209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:03.723814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0683f18-5e52-4912-8688-70d12ee60e3a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:03.764094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:03.765441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:03.766041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:03.766539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:03.768117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:03.769896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:03.772105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 212/426] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:03 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:03.780352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:03.783114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 215/427] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:04:03.802722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:03.806827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:03.898272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ade7-e8bc-4e1e-9b6f-ffe3c9803c1d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:03.937495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:03.938514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:03.939025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:03.939501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:03.940640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=45afb887c4d943998202e1bc7943bb06) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:03.941230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:03.943091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:03.957463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:03.958486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 213/428] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:04:03 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=e5e16600844f49db892c00085568f6e8 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:03.992141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962cff-8071-4ab6-879d-8bebc7d501c2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:04.034334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077bd32-fd4b-42a4-84f1-25814b861446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:04.035217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077bd32-fd4b-42a4-84f1-25814b861446 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.035498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077bd32-fd4b-42a4-84f1-25814b861446 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.035774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077bd32-fd4b-42a4-84f1-25814b861446 None admin] PATH_INFO: `/v3/projects/45afb887c4d943998202e1bc7943bb06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.037062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077bd32-fd4b-42a4-84f1-25814b861446 None admin] RBAC: Authorizing `identity:get_project(project_id=45afb887c4d943998202e1bc7943bb06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:04.038546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077bd32-fd4b-42a4-84f1-25814b861446 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:04.040755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 216/429] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:03 2022] GET /identity/v3/projects/45afb887c4d943998202e1bc7943bb06 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:04.046161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:04.174080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:04.180145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66b63-986e-4766-a244-1b3d5fdf93af None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.180426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66b63-986e-4766-a244-1b3d5fdf93af None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.180704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66b63-986e-4766-a244-1b3d5fdf93af None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.182334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 217/430] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:04.187894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766481f1-9958-43ca-9223-edc01039173a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.188464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766481f1-9958-43ca-9223-edc01039173a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.188940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766481f1-9958-43ca-9223-edc01039173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.195897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e67227-69c2-4b39-a135-84034e03fca0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:04.212087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-766481f1-9958-43ca-9223-edc01039173a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:04.215800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-766481f1-9958-43ca-9223-edc01039173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:04.258118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:04.259115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.259436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.259717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.262657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:04.265206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:04.267324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 214/431] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:04 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:04.273138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:04.308588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 218/432] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:04.340164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766481f1-9958-43ca-9223-edc01039173a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:04.399335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e22aea-eb6b-4e1a-b9c3-a53994fbf2be None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:04.416311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:04.437807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:04.438391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.438684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.438966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.439808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=45afb887c4d943998202e1bc7943bb06) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:04.440121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:04.441644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:04.448259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 215/433] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:04:04 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=45afb887c4d943998202e1bc7943bb06&role.id=82e9eb17bbd04cf888953955a1c648af => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:04.450624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766481f1-9958-43ca-9223-edc01039173a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:04.501743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:04.502568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.502858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.503135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.517347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:04.525580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:04.526540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:04.527323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 219/434] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:04.535262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:04.561286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:04.662046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ea9f2-8ee6-4f5b-abc9-28f97ced9075 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:04.704083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5ea1b-1230-4db2-a6c8-593e7fc033de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:04.705145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5ea1b-1230-4db2-a6c8-593e7fc033de None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.705627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5ea1b-1230-4db2-a6c8-593e7fc033de None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.706094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5ea1b-1230-4db2-a6c8-593e7fc033de None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.707048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5ea1b-1230-4db2-a6c8-593e7fc033de None admin] RBAC: Adding query filter params (name=member) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:04.707570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5ea1b-1230-4db2-a6c8-593e7fc033de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:04.709255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d5ea1b-1230-4db2-a6c8-593e7fc033de None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:04.719669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 216/435] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:04.725290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:04.734311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef47ea-89de-4b7b-918a-99f0fbdc0657 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.734618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef47ea-89de-4b7b-918a-99f0fbdc0657 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.734884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef47ea-89de-4b7b-918a-99f0fbdc0657 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.736282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 217/436] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:04.742058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972610b-6703-47d4-afe8-4a6c0d02bc69 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.742353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972610b-6703-47d4-afe8-4a6c0d02bc69 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.742631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972610b-6703-47d4-afe8-4a6c0d02bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:04.767826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3972610b-6703-47d4-afe8-4a6c0d02bc69 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:04.769329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3972610b-6703-47d4-afe8-4a6c0d02bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:04.859955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 218/437] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:04.874248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0527f2f9-41e1-4952-8f0b-61d883b51501 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:04.883735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972610b-6703-47d4-afe8-4a6c0d02bc69 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:04.893047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:04.908903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:04.919210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:04.920132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:04.920520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:04.920917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.009256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972610b-6703-47d4-afe8-4a6c0d02bc69 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.012525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.014079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.056109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7fe2d4-56de-41e1-b890-018ad1ea1e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.059291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fe2d4-56de-41e1-b890-018ad1ea1e09 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.059291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fe2d4-56de-41e1-b890-018ad1ea1e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.059291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7fe2d4-56de-41e1-b890-018ad1ea1e09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.073819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7fe2d4-56de-41e1-b890-018ad1ea1e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7d7fe2d4-56de-41e1-b890-018ad1ea1e09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:05.083260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:05.084203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 219/438] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:05.086592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdc03-a596-47de-b982-f17ecb1d4341 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.087493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdc03-a596-47de-b982-f17ecb1d4341 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.087493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cdc03-a596-47de-b982-f17ecb1d4341 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.087780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 220/439] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:05.093863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08723-9fe6-4f43-b25b-625f83aadc13 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.094146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08723-9fe6-4f43-b25b-625f83aadc13 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.094428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a08723-9fe6-4f43-b25b-625f83aadc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.113591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-84a08723-9fe6-4f43-b25b-625f83aadc13 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:05.114901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-84a08723-9fe6-4f43-b25b-625f83aadc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:05.142053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 220/440] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:05.143539 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.174161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.189255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.196326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 221/441] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:05.197931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08723-9fe6-4f43-b25b-625f83aadc13 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.247381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d6f94-6789-4567-ba7b-4a72f8ca5ed9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.282763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.283351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.283639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.283917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.284769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:05.285017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.286397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.295433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 221/442] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:05.296488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.300076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a08723-9fe6-4f43-b25b-625f83aadc13 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.339958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.340811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.341120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.341389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.343386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.344840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.346570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 222/443] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:05.347334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.398160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.407180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb21b988-ab6a-4888-95f7-48212338d19a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.412607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.442820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.443609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.443895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.444175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.451534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547718b5-d07d-4d04-b730-9cab678a73e0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.455145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:05.463021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:05.464759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 222/444] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:05.466149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.492133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.492781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.493087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.493361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.564187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.565711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.569707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ad5127-ff8e-4766-b4da-e9399ce9e9f8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.603923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.604783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.605088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.605363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.606541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.608834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.610491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 223/445] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:05.611295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.628624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.635062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.667301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 223/446] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:05.668937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.723086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb470-21a3-43ab-9454-86ba6edfd368 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.759679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.760348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.760627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.760901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.767434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:05.767434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.767434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.772865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9efb9-4dd2-4737-bdf8-a55d49cd72ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.773387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 224/447] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:05.774232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.815091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.815666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.815953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.816234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.817107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=82e9eb17bbd04cf888953955a1c648af, scope.project.id=74d14621b0374c92b384d824a365386b) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:05.817425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.818866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.824816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 224/448] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=82e9eb17bbd04cf888953955a1c648af => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:05.825639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.859021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.890087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:05.911340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b06a6b-68db-4288-b7d1-7af6d674ff2e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.941879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b21c4c-4ff3-4d8b-b796-9ce8cacecafd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:05.950134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.951076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.951522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.951806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] PATH_INFO: `/v3/projects/74d14621b0374c92b384d824a365386b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:05.953121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] RBAC: Authorizing `identity:get_project(project_id=74d14621b0374c92b384d824a365386b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:05.954604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:05.956724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 225/449] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/projects/74d14621b0374c92b384d824a365386b => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:05.962388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:05.985413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:05.986484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:05.986770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:05.987049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:06.073822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:06.075222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:06.083869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bd31a-a9d9-47eb-b0bc-7d6a32b7d561 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:06.109379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:06.128303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:06.129295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:06.129489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:06.129770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] PATH_INFO: `/v3/groups/c1be7caa193b414683d08a441821a05a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:06.131141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] RBAC: Authorizing `identity:get_group(group_id=c1be7caa193b414683d08a441821a05a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:06.132440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:06.134242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 226/450] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/groups/c1be7caa193b414683d08a441821a05a => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:06.140933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:06.162963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:06.199261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 225/451] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:06.205851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:06.254573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e553d6-86e8-4d26-bd3e-94d1eb223537 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:06.289374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:06.289998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:06.290284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:06.290563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:06.291394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] RBAC: Adding query filter params (group.id=c1be7caa193b414683d08a441821a05a, role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=74d14621b0374c92b384d824a365386b) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:06.291708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:06.293277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:06.300173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 227/452] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:04:06 2022] GET /identity/v3/role_assignments?group.id=c1be7caa193b414683d08a441821a05a&scope.project.id=74d14621b0374c92b384d824a365386b&role.id=e5e16600844f49db892c00085568f6e8 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:06.311786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59bdb5-ff75-4c71-955b-d14bcdbd5489 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:06.342210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:06.350301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:06.360331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:06.360331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:06.360331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] PATH_INFO: `/v3/projects/8a3405aadfe54be0a4fabaa1726d8751` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:06.360331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] RBAC: Authorizing `identity:get_project(project_id=8a3405aadfe54be0a4fabaa1726d8751)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:06.360331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:06.360331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 226/453] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:04:06 2022] GET /identity/v3/projects/8a3405aadfe54be0a4fabaa1726d8751 => generated 344 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:06.362741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:06.454195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:06.472509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0831-0e6a-4dbd-8343-4636c31e1a0c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:06.508049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981abe68-ac6a-45dc-bd2b-e5414246b1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:06.508903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981abe68-ac6a-45dc-bd2b-e5414246b1fa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:06.509222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981abe68-ac6a-45dc-bd2b-e5414246b1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:06.509501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981abe68-ac6a-45dc-bd2b-e5414246b1fa None admin] PATH_INFO: `/v3/groups/db7e02dd74f341c0b7ac16005be6d45c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:06.510682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981abe68-ac6a-45dc-bd2b-e5414246b1fa None admin] RBAC: Authorizing `identity:get_group(group_id=db7e02dd74f341c0b7ac16005be6d45c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:06.512138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981abe68-ac6a-45dc-bd2b-e5414246b1fa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:06.514037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 228/454] 10.222.0.27 () {56 vars in 1180 bytes} [Mon Jul 18 06:04:06 2022] GET /identity/v3/groups/db7e02dd74f341c0b7ac16005be6d45c => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:06.520049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:06.629528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfd8b0-7750-444c-b7ae-406d7ef5adb1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:06.665801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4fe014-e0dd-4036-a87c-8c24767d3eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:06.666461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fe014-e0dd-4036-a87c-8c24767d3eee None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:06.666747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fe014-e0dd-4036-a87c-8c24767d3eee None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:06.667027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fe014-e0dd-4036-a87c-8c24767d3eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:06.667867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fe014-e0dd-4036-a87c-8c24767d3eee None admin] RBAC: Adding query filter params (group.id=db7e02dd74f341c0b7ac16005be6d45c, role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=8a3405aadfe54be0a4fabaa1726d8751) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:06.668179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fe014-e0dd-4036-a87c-8c24767d3eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:06.669912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4fe014-e0dd-4036-a87c-8c24767d3eee None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:06.676147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 227/455] 10.222.0.27 () {56 vars in 1376 bytes} [Mon Jul 18 06:04:06 2022] GET /identity/v3/role_assignments?group.id=db7e02dd74f341c0b7ac16005be6d45c&scope.project.id=8a3405aadfe54be0a4fabaa1726d8751&role.id=a30b539353cf42d08ab504edac924aa8 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:09.257020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219fc65-459b-43e2-bb9d-93b5d6708ca0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.257542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219fc65-459b-43e2-bb9d-93b5d6708ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.257617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219fc65-459b-43e2-bb9d-93b5d6708ca0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.259233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 229/456] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:09.265456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d0d23-2c8d-4275-bbef-a6c4dbc53030 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.265919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d0d23-2c8d-4275-bbef-a6c4dbc53030 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.265993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413d0d23-2c8d-4275-bbef-a6c4dbc53030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.293585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-413d0d23-2c8d-4275-bbef-a6c4dbc53030 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:09.295755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-413d0d23-2c8d-4275-bbef-a6c4dbc53030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:09.383226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:09.398771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 228/457] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:09.431640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219fc65-459b-43e2-bb9d-93b5d6708ca0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:09.581252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219fc65-459b-43e2-bb9d-93b5d6708ca0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:09.631355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:09.631953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d864-63b3-4992-8933-c29338abdef9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.632163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.632449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.632694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d864-63b3-4992-8933-c29338abdef9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.632826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.633259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052d864-63b3-4992-8933-c29338abdef9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.635049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 229/458] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:09.641535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c75dfd-086f-48d4-8c67-ffbf6fd8c989 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.642051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c75dfd-086f-48d4-8c67-ffbf6fd8c989 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.642495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c75dfd-086f-48d4-8c67-ffbf6fd8c989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.653341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:09.662850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:09.678033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-30c75dfd-086f-48d4-8c67-ffbf6fd8c989 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:09.679863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30c75dfd-086f-48d4-8c67-ffbf6fd8c989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:09.685071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:09.705655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:09.706538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:09.706538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:09.706538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:09.706538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:09.706538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 230/459] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:09.706538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:09.706538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:09.793170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 230/460] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:09.795071 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7507c2-2ea1-44b2-acc4-468c1e17643c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.795367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7507c2-2ea1-44b2-acc4-468c1e17643c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.795650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7507c2-2ea1-44b2-acc4-468c1e17643c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.797191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 231/461] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:09.801026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b38f7-4bae-4e98-823f-3f7a01ac98da None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.801026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b38f7-4bae-4e98-823f-3f7a01ac98da None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.801026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b38f7-4bae-4e98-823f-3f7a01ac98da None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.801026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 232/462] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:09.802581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c96c7-565f-4ab3-93e2-6ead1f280686 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.802871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c96c7-565f-4ab3-93e2-6ead1f280686 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.803145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c96c7-565f-4ab3-93e2-6ead1f280686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.823057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ba2c96c7-565f-4ab3-93e2-6ead1f280686 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:09.824298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ba2c96c7-565f-4ab3-93e2-6ead1f280686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:09.841904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd57105-3885-4f65-9726-f2eba6fb16dd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:09.879672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf065982-169a-49ce-86d3-297f4e585d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:09.880355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065982-169a-49ce-86d3-297f4e585d8d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.880640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065982-169a-49ce-86d3-297f4e585d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.880902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf065982-169a-49ce-86d3-297f4e585d8d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.881645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf065982-169a-49ce-86d3-297f4e585d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:09.882035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf065982-169a-49ce-86d3-297f4e585d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:09.883407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf065982-169a-49ce-86d3-297f4e585d8d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:09.896372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 231/463] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:09.897777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b274023-41ca-4412-b3a7-ef780bfcba06 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:09.898079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b274023-41ca-4412-b3a7-ef780bfcba06 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:09.898362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b274023-41ca-4412-b3a7-ef780bfcba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:09.899777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 233/464] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:09.901108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c96c7-565f-4ab3-93e2-6ead1f280686 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:09.916922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2b274023-41ca-4412-b3a7-ef780bfcba06 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:09.918164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b274023-41ca-4412-b3a7-ef780bfcba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:09.961784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:09.984006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:09.995080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 232/465] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:09.996324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b274023-41ca-4412-b3a7-ef780bfcba06 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.028185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c96c7-565f-4ab3-93e2-6ead1f280686 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.067659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.068460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.068745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.069046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.080930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.082580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:10.103326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:10.104192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:10.105067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:10.105067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:10.105067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:10.105067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:10.105067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 234/466] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:10.105336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.113670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b274023-41ca-4412-b3a7-ef780bfcba06 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.152754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.153816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.154183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.154464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.155495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.157123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.215673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13abe-6d70-4d8d-8c32-909a79da9245 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.217250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:10.243711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 233/467] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:04:09 2022] POST /identity/v3/users => generated 246 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:10.243711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.261994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.262809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.263149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.263534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.277948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.279596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:10.314060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:10.315108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:10.316085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:10.316085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:10.316085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:10.316085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:10.316085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 235/468] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:10.317474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.329643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:10.396321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bd09cd-40d4-4c47-9ebd-2a96254c33ac None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.439917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.441242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.441670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.442100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.447442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa90ad3-5382-4f3d-867f-f8827135a0aa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.456239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.457767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:10.476331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:10.477417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:10.478258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:10.478258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:10.478258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:10.478258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:10.483803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 234/469] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:10.485236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.489427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb8f2a-9213-4c44-afc2-de78919f9dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.490108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8f2a-9213-4c44-afc2-de78919f9dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.490386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8f2a-9213-4c44-afc2-de78919f9dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.490664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8f2a-9213-4c44-afc2-de78919f9dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.491395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb8f2a-9213-4c44-afc2-de78919f9dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:10.491724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb8f2a-9213-4c44-afc2-de78919f9dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.493249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb8f2a-9213-4c44-afc2-de78919f9dd4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.506415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 236/470] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:10.507724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9261-7e67-4f2b-bc91-14db1aac793c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.508011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9261-7e67-4f2b-bc91-14db1aac793c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.508293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e9261-7e67-4f2b-bc91-14db1aac793c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.509725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 237/471] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:10.510230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9261-7e67-4f2b-bc91-14db1aac793c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.528004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:10.604385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:10.608005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c50a4-d630-45dc-a253-3c401eceaae0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.625254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e9261-7e67-4f2b-bc91-14db1aac793c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.645223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22953113-fd3a-4232-9b64-da56db9b2640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.646903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953113-fd3a-4232-9b64-da56db9b2640 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.647473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953113-fd3a-4232-9b64-da56db9b2640 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.648200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22953113-fd3a-4232-9b64-da56db9b2640 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.649621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953113-fd3a-4232-9b64-da56db9b2640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:10.650266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953113-fd3a-4232-9b64-da56db9b2640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.651662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22953113-fd3a-4232-9b64-da56db9b2640 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.661405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.662063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.662351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.662622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.663342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:10.663650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.665038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.666218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 235/472] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:10.667476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf220473-7c44-4771-8f17-7089e1b69d46 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.667772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf220473-7c44-4771-8f17-7089e1b69d46 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.668130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf220473-7c44-4771-8f17-7089e1b69d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.684620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 238/473] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:10.686399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bf220473-7c44-4771-8f17-7089e1b69d46 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:10.686759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.687925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bf220473-7c44-4771-8f17-7089e1b69d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:10.815748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 236/474] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:10.816930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf220473-7c44-4771-8f17-7089e1b69d46 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:10.833834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:10.861576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f2fd2-979f-45eb-b136-eb68f5617a43 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.897308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.898023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.898303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.898581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.899291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.900720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:10.920944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:10.930733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf220473-7c44-4771-8f17-7089e1b69d46 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:10.964153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:10.964814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:10.965151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:10.965408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:10.966110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:10.968409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:11.006564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 239/475] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:04:10 2022] POST /identity/v3/users => generated 248 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:11.007390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:11.127118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 237/476] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:04:10 2022] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:11.128156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:11.150019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2760d80-caf5-4344-9164-87f3ec62368d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:11.193950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:11.207203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:11.208033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:11.208379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:11.215870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:11.215870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:11.215870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:11.298263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b31fd-b0f8-4a81-bbf9-e7b9d386675b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:11.316472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 240/477] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:04:11 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:11.344491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:11.345218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:11.345505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:11.345786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:11.346564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:11.348004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:11.383924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.sql.core [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 06:04:11.383924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 06:04:11.383924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [parameters: {'id': '1a8ddbd1c56b478a8eaffd50f7760bd6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 06:04:11.383924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 18 06:04:11.401760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 06:04:11.403446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application yield resource Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise self.value Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application session.commit() Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 06:04:11.405914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.flush() Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application compat.raise_( Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 06:04:11.407788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 06:04:11.409749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 06:04:11.411351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [parameters: {'id': '1a8ddbd1c56b478a8eaffd50f7760bd6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:11.412410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 06:04:11.413693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:11.415147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 238/478] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 18 06:04:11 2022] POST /identity/v3/roles => generated 144 bytes in 275 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:11.415248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:11.547865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e7bca6-a878-474a-8ba4-4cd0a380f3ae None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:11.588634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa65f85-8630-47b2-8850-5e09dc7ed30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:11.589958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa65f85-8630-47b2-8850-5e09dc7ed30c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:11.590441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa65f85-8630-47b2-8850-5e09dc7ed30c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:11.590911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa65f85-8630-47b2-8850-5e09dc7ed30c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:11.609431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa65f85-8630-47b2-8850-5e09dc7ed30c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-eaa65f85-8630-47b2-8850-5e09dc7ed30c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:11.618543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:11.619453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 06:04:11.620254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:11.628142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 241/479] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:11.629824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:11.649371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:11.764764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98cf52-28d4-4048-9ce0-7e712bcf65af None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:11.808317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121988a4-d39d-417d-a0b3-6d2d099d5480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:11.809013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121988a4-d39d-417d-a0b3-6d2d099d5480 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:11.809301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121988a4-d39d-417d-a0b3-6d2d099d5480 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:11.809580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121988a4-d39d-417d-a0b3-6d2d099d5480 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:11.810893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121988a4-d39d-417d-a0b3-6d2d099d5480 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:11.811412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121988a4-d39d-417d-a0b3-6d2d099d5480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:11.812945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121988a4-d39d-417d-a0b3-6d2d099d5480 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:11.821813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 239/480] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:12.579583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2753-3895-4ade-9963-104e02998824 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:12.580067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2753-3895-4ade-9963-104e02998824 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:12.580067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f2753-3895-4ade-9963-104e02998824 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:12.581463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 242/481] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:12.598881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ebf03-6868-41f2-9eb9-a792fcb120f0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:12.599389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ebf03-6868-41f2-9eb9-a792fcb120f0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:12.599466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396ebf03-6868-41f2-9eb9-a792fcb120f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:12.622252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-396ebf03-6868-41f2-9eb9-a792fcb120f0 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:12.624507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-396ebf03-6868-41f2-9eb9-a792fcb120f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:12.718927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:12.762614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2753-3895-4ade-9963-104e02998824 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:12.850250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:12.921441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f2753-3895-4ade-9963-104e02998824 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:12.963043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:12.963838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:12.964119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:12.964394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:12.981817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:12.990548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:12.991440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:12.992217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:12.996673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 243/483] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:12.998795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ebf03-6868-41f2-9eb9-a792fcb120f0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:13.001023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:13.131890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396ebf03-6868-41f2-9eb9-a792fcb120f0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:13.172745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:13.173359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.173731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.174010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.174769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:13.175072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:13.176462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:13.186450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 241/484] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:13.191701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:13.331114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9191b1-29f4-4fae-b54d-257472bbc292 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:13.342601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:13.366895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:13.370330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.370330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.370330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.382101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:13.383507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:13.402209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:13.403111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:13.406647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:13.406647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:13.406647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:13.406647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:13.406647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 244/485] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:13.409643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:13.547993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:13.604109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c9e26c-a32e-428a-af2c-2baefeb669ff None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:13.653770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40847e6a-f839-41d2-a70d-f5488a506e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:13.655197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847e6a-f839-41d2-a70d-f5488a506e10 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.655486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847e6a-f839-41d2-a70d-f5488a506e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.655764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40847e6a-f839-41d2-a70d-f5488a506e10 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.656491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40847e6a-f839-41d2-a70d-f5488a506e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:13.656798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40847e6a-f839-41d2-a70d-f5488a506e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:13.658284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40847e6a-f839-41d2-a70d-f5488a506e10 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:13.678684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 242/486] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:13.684690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:13.770878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61ded6-dbcf-41f3-89bd-af3794757fe0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.771195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61ded6-dbcf-41f3-89bd-af3794757fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.771444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c61ded6-dbcf-41f3-89bd-af3794757fe0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.772953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 243/487] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:04:13.780034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36112623-3ce6-4ae2-afb6-eabe7f9bec04 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.780323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36112623-3ce6-4ae2-afb6-eabe7f9bec04 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.780602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36112623-3ce6-4ae2-afb6-eabe7f9bec04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.813265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-36112623-3ce6-4ae2-afb6-eabe7f9bec04 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:13.814475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-36112623-3ce6-4ae2-afb6-eabe7f9bec04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:13.819776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547da08c-acc6-4af1-ac3c-41bb16665280 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:13.867201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b60a2e-d8f0-4802-bfb0-33a811b1a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:13.868034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60a2e-d8f0-4802-bfb0-33a811b1a174 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.868317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60a2e-d8f0-4802-bfb0-33a811b1a174 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.868592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b60a2e-d8f0-4802-bfb0-33a811b1a174 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.880334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b60a2e-d8f0-4802-bfb0-33a811b1a174 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:13.881923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b60a2e-d8f0-4802-bfb0-33a811b1a174 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:13.905384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 244/488] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:13.905384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30583ee4-6b99-4435-8892-a041584ac271 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-54b60a2e-d8f0-4802-bfb0-33a811b1a174 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:13.905613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:13.906423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:13.907294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:13.907809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30583ee4-6b99-4435-8892-a041584ac271 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.907809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30583ee4-6b99-4435-8892-a041584ac271 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.907937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 245/489] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:04:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:13.907937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a437ba0-95f7-4e50-b117-56e38b996786 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.907937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a437ba0-95f7-4e50-b117-56e38b996786 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.907937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a437ba0-95f7-4e50-b117-56e38b996786 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.907937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 246/490] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:13.908215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 245/491] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:13.910457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a437ba0-95f7-4e50-b117-56e38b996786 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:13.912816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed157-c41e-43c7-bacb-63935b680d83 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:13.913137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed157-c41e-43c7-bacb-63935b680d83 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:13.913426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed157-c41e-43c7-bacb-63935b680d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:13.932753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:13.940402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-91bed157-c41e-43c7-bacb-63935b680d83 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:13.941625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-91bed157-c41e-43c7-bacb-63935b680d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:13.995591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.019055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 246/492] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:14.020601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06a5d-dc76-4b5b-a288-42bd1d60277c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.021086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06a5d-dc76-4b5b-a288-42bd1d60277c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.021488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b06a5d-dc76-4b5b-a288-42bd1d60277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.033697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a437ba0-95f7-4e50-b117-56e38b996786 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.047079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-92b06a5d-dc76-4b5b-a288-42bd1d60277c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:14.048335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-92b06a5d-dc76-4b5b-a288-42bd1d60277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:14.069971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.070631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.070915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.071193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.072027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:14.072338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:14.073823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:14.111562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 247/493] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:04:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:14.112408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.127978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 247/494] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:14.129299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06a5d-dc76-4b5b-a288-42bd1d60277c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.215809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.240603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431eb4df-7746-4eb0-bd17-d42e5389f09e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.244446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b06a5d-dc76-4b5b-a288-42bd1d60277c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.259284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.280428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.281376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.281680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.282100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.282208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.282442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.282746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.282884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.294773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:14.296299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:14.302734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:14.303595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:14.304646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:14.307338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:14.308202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:14.309040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 248/495] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:14.309691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.310205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 248/496] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:14.311080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.465641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3913c92-4487-4b92-8ee4-eb1793511154 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.466548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa6d0-65e1-474f-b8d8-64422df4f31a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.518345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.518744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.519318 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.519771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.519976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.520230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.520432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.520970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.526974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.536806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:14.551445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:14.552328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:14.553250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 249/497] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:14.554803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.597351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.616810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:14.618309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:14.676796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0e3fed-767e-4940-bb86-51d0693e13d4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.716109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.717016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.717307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.717522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.718307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:14.718587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:14.720036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:14.728267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 250/498] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:14.728724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 249/499] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:14.729204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.730187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.775468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.837740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.843863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad819fd-a06c-4b43-b8de-083d48f3c855 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.844016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d287e20a-b1bc-4b5c-bfaf-92e2a183fe8c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.877900 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.878563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.878849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.879157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.879976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:14.880077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:14.880283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:14.880650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:14.880930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:14.881232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:14.881671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:14.881973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:14.882273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:14.883882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:14.890100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 251/500] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:14.890723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.896948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 250/501] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:14.896948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:14.991518 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:14.994993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f0940-dfd5-4fe8-8545-e9ef68636345 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:14.996627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908a76-0cdd-429d-9187-36fe14f539fd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.029512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a3fe7-21e0-4c27-82c4-788b040f0d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.030306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3fe7-21e0-4c27-82c4-788b040f0d63 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.030591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3fe7-21e0-4c27-82c4-788b040f0d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.030868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a3fe7-21e0-4c27-82c4-788b040f0d63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.031799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.032592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.032876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.033187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.041415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a3fe7-21e0-4c27-82c4-788b040f0d63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.042939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a3fe7-21e0-4c27-82c4-788b040f0d63 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.043644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.045935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-156a3fe7-21e0-4c27-82c4-788b040f0d63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:15.062190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:15.063212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:15.069410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:15.069410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:15.069410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.069410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:15.069410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 251/502] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:15.069666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:15.070571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:15.071588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:15.071588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:15.071588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.071588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:15.071847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31047ccd-c72c-4ebf-bfb0-9815ef909c4b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.071922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 252/503] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:15.071986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31047ccd-c72c-4ebf-bfb0-9815ef909c4b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.071986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31047ccd-c72c-4ebf-bfb0-9815ef909c4b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.072120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.072187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 252/504] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:15.072187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31047ccd-c72c-4ebf-bfb0-9815ef909c4b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.083087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.171222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b38146-4e6c-49a5-9ed9-d42622a8c338 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.171490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31047ccd-c72c-4ebf-bfb0-9815ef909c4b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.205081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.205860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.206038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.206164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.206401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.206829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.207116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.207398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.218191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.219104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.219649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.220553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:15.238044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:15.238925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:15.239761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:15.239761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:15.239761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.239761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:15.239977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:15.240921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:15.241853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:15.241853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:15.241853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.241853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:15.242063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 253/505] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:15.242063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.243959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 253/506] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:15.244786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.247545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.309184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.348963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b6df6-edaa-4a14-a057-8656cb2bf4ea None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.349446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9adca-9d85-4df6-a05a-023eb98463a2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.385640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145c1b4-ccbf-4111-8939-5ec856fa0e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.386574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145c1b4-ccbf-4111-8939-5ec856fa0e6d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.386955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145c1b4-ccbf-4111-8939-5ec856fa0e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.387373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145c1b4-ccbf-4111-8939-5ec856fa0e6d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.388237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.389857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.389977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145c1b4-ccbf-4111-8939-5ec856fa0e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:15.390312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.390400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145c1b4-ccbf-4111-8939-5ec856fa0e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.390754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.391916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:15.392414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.392703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145c1b4-ccbf-4111-8939-5ec856fa0e6d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.394803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.415803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 254/507] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:15.415993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 254/508] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:15.416100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c454d0-f99d-4e49-99b4-78aa73c46099 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.416185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.416265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c454d0-f99d-4e49-99b4-78aa73c46099 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.416265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c454d0-f99d-4e49-99b4-78aa73c46099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.433094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-75c454d0-f99d-4e49-99b4-78aa73c46099 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:15.434282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-75c454d0-f99d-4e49-99b4-78aa73c46099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:15.479323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.505665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 255/509] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:15.506854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c454d0-f99d-4e49-99b4-78aa73c46099 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.520697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e69abc-f933-4e85-a1fa-e47fda2a40dd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.556801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.557487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.557765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.558045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.558758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:15.559059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.560636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.564177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.572062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 255/510] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:15.582418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.612319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c454d0-f99d-4e49-99b4-78aa73c46099 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.646708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.647390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.647672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.647941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.648789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:15.649128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.650508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.662729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 256/511] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:15.663559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.675624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e6ffd-6a00-468d-a7dc-ecc080e0772d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.698478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.716017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.717468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.717753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.718025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.725648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.727087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:15.741488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:15.742898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 256/512] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:15.744123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.772838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65978a-a1b8-4bdd-8bce-ae80d8c1d274 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.785636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.806713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.807498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.807782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.808060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.815238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.816735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:15.831881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:15.832939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 257/513] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:15.838646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.846863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf739d-1a81-482f-b88a-e3a69b13e28a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.882719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.883500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.883787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.884053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.895732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.897209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:15.914513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:15.915361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:15.916185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:15.916185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:15.916185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:15.916185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:15.916185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 257/514] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:15.916875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:15.939317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060c328-2749-411e-8b9e-c3763fb7c570 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:15.953673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:15.974488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:15.975283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:15.975564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:15.976805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:15.983340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:15.984902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:16.001137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:16.002250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:16.003183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 258/515] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:16.003720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.027320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05916c6-b516-485f-9e13-360f1904d1b7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.034365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.063445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.064230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.064513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.064785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.071923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.073456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:16.089124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:16.090204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 258/516] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:16.091104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.107537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac80cc75-7063-4d48-97b4-7cba05f7c1b9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.143049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.143744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.144029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.144309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.145178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:16.145495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.146950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.182737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 259/517] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:16.183535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.183651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.194530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb29f08-9f71-4fd6-a0ac-df699ca441b0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.230143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.230811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.231092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.231372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.232687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:16.233104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.234581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.253575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 259/518] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:16.254716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.280727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.290112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082815e0-c814-46c4-b6a7-38e16de799e9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.329457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.330207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.330491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.330773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.331496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:16.331833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.333435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.344857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 260/519] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:16.345703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.362507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735691e-a7c9-49d1-90b7-f9d37a27593a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.397185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.397852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.398135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.398412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.399253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:16.399719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.401066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.418178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 260/520] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:16.418997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.436629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.448375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7317e9de-fd8d-4fc0-aebc-0b8aafdae770 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.481659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.483396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.483678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.483957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.484786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:16.485117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.486569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.504234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 261/521] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:16.505273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.515584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.520422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c1aba-1a5c-4d6f-971b-c9715434776f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.556522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.557146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.557434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.557712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.607730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e07b2f-4b0e-460a-8315-3827a06f5d11 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.626278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.627749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.642191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.642462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.643125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.643410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.643686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.644529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=065014e1d5984a3db142381ccc62a420) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:16.644842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.646298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.651761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 262/522] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/role_assignments?user.id=065014e1d5984a3db142381ccc62a420&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:16.652532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.744283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.747412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 261/523] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:16.748745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.778357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b18eb-f50e-42fd-b98a-cab747910695 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.821192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.821612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.821895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.822165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.822866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.824288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:16.859702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664ec1e-e194-4dd2-8d6a-b23705b405e5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:16.873081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:16.893343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:16.893993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:16.894277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:16.894556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:16.949111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 263/524] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:04:16 2022] POST /identity/v3/users => generated 247 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:16.949962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:16.985589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:16.987951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.086387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0ba2e7-b0a6-402d-9bbf-14e76532a675 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.125041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 262/525] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:17.125041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.125286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:17.134221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.142664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.142664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.142664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.142913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:17.228301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.230111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.249676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6793b6f8-909a-49df-9569-9b376098f30f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.295539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.295738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.295979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.296256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.309730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.317022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:17.335818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:17.336772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:17.337710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:17.337710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:17.337710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:17.337710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:17.337710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 263/526] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:17.338392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.341128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 264/527] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:17.345113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.391230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:17.424008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:17.467446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9b3252-1f03-4284-8ed1-f35df0d5d379 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.470959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01330e5-be67-4bc0-aee3-1631efabd9c0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.505470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.506337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.506749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.506999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.507287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.507457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.507557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.507989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.508273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:17.508583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.509999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.521550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.525056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 265/528] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:17.525056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.527782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:17.548243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:17.549390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:17.550429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:17.550429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:17.550429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:17.550429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:17.550429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 264/529] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:17.550887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.620520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:17.632951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78e39-7dc3-4796-867e-82e2f38f86f6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.667801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da7394c-7146-4796-9340-8ccefef68b6b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.671722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.672703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.673162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.673642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.686721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.688174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:17.689346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.708216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:17.708581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:17.709566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:17.710760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:17.710760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:17.710760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:17.710760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:17.711016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.711016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.711016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.717372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 266/530] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:17.718198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.718585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.720145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:17.740627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:17.741757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:17.742858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 265/531] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:17.743306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.842179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb468b21-5cd3-4b22-9769-9444a4e5af40 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.876565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18facc70-fe6f-4a5e-bb79-7a1418dc3ded None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:17.887350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.888137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.889012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.889746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.890903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:17.891292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.893462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.905378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:17.910524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 267/532] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:17.911673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.915007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:17.921701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:17.921701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:17.921701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:17.921701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:17.921701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:17.921701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:17.933580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 266/533] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:17.934504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:17.974382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:18.041366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25ed81-2c82-46bd-98f0-e803b04980f5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.045744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa19931-fb86-407d-84a2-762cb6c12b38 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.082546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:18.083502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.083930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.084310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.085702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:18.086609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.086898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.087571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.088373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:18.088685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:18.090155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:18.092267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:18.093933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:18.110864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 268/534] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:18.111717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:18.113941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:18.115848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:18.118407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 267/535] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:18.125000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:18.201918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:18.238748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:18.241936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e5bd07-510a-4725-864a-1d862c21ab40 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.247302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fbb7e-0d2a-4294-81ac-8020621992b5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.281486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:18.282625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.283102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.283573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.291523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:18.295225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:18.295225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.295225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.295477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.296165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=aff4923457aa4be498f954c73f4d0018) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:18.296480 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:18.297963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:18.299821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:18.309010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 268/536] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:18 2022] GET /identity/v3/role_assignments?user.id=aff4923457aa4be498f954c73f4d0018&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:18.309010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:18.343710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:18.344685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:18.345531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 269/537] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:18.351141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:18.466070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd1f3b-91d1-4515-99ad-f45585ffca57 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.511200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:18.511875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.512162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.512444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.513331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:18.513767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:18.521015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:18.535407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 269/538] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:18.537362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:18.566099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:18.569845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4294721-694c-42c8-90c9-2375bb72c74a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.596186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:18.623866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:18.624994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.625498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.625970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.626981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:18.627643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:18.633454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:18.659314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 270/539] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:18.665441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:18.670596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb7a6f-c73d-485b-b9bc-466a031bdf2e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.712349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d982a7a-1429-4c48-a1ac-501ea903814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:18.713022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982a7a-1429-4c48-a1ac-501ea903814e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.713315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982a7a-1429-4c48-a1ac-501ea903814e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.713595 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d982a7a-1429-4c48-a1ac-501ea903814e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.714538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982a7a-1429-4c48-a1ac-501ea903814e None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=81aa1b5c138247b9b7e0d65fb12af27a) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:18.715169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982a7a-1429-4c48-a1ac-501ea903814e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:18.717528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d982a7a-1429-4c48-a1ac-501ea903814e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:18.729603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 270/540] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:18 2022] GET /identity/v3/role_assignments?user.id=81aa1b5c138247b9b7e0d65fb12af27a&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:18.792142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54dc0a-239d-4c6a-8c8e-50093f841114 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.792482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54dc0a-239d-4c6a-8c8e-50093f841114 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.792705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54dc0a-239d-4c6a-8c8e-50093f841114 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.795397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 271/541] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:04:18.803408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7ca9-beca-4f2a-8cbf-79064fd1d923 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:18.803728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7ca9-beca-4f2a-8cbf-79064fd1d923 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:18.803984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f7ca9-beca-4f2a-8cbf-79064fd1d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:18.825929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-990f7ca9-beca-4f2a-8cbf-79064fd1d923 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:18.828037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-990f7ca9-beca-4f2a-8cbf-79064fd1d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:18.903590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f5d27-d3f4-4349-adba-23ecace77e35 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:18.933392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 272/542] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:18.954088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f7ca9-beca-4f2a-8cbf-79064fd1d923 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:18.971536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:19.021399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:19.022067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.022356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.022637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.023478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=f44e152499fc494085c738c67d0397f0) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:19.023796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:19.025313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:19.031490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 271/543] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:18 2022] GET /identity/v3/role_assignments?user.id=f44e152499fc494085c738c67d0397f0&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 259 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:19.075932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f7ca9-beca-4f2a-8cbf-79064fd1d923 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:19.119019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e1486-8bcd-4dda-a2f1-8fe83391ad4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:19.120139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e1486-8bcd-4dda-a2f1-8fe83391ad4f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.120593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e1486-8bcd-4dda-a2f1-8fe83391ad4f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.121058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e1486-8bcd-4dda-a2f1-8fe83391ad4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.134094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e1486-8bcd-4dda-a2f1-8fe83391ad4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3b0e1486-8bcd-4dda-a2f1-8fe83391ad4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:19.142774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:19.143747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:19.144536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:19.147078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 273/544] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:19.153054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:19.230550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:19.310493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cd2360-8bea-4b32-a6be-1b30632bf811 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:19.346418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba6afd-078e-4626-8296-3f526ca9bbfc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.347041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba6afd-078e-4626-8296-3f526ca9bbfc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.347515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba6afd-078e-4626-8296-3f526ca9bbfc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.349620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 274/545] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:19.355026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265bd3-d9c2-4e6d-8c7b-58aaba81ffff None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.355565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265bd3-d9c2-4e6d-8c7b-58aaba81ffff None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.356102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13265bd3-d9c2-4e6d-8c7b-58aaba81ffff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.370344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:19.371056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.371376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.371613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.372373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:19.373357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:19.375071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:19.377211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-13265bd3-d9c2-4e6d-8c7b-58aaba81ffff None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:19.379435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-13265bd3-d9c2-4e6d-8c7b-58aaba81ffff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:19.392528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 272/546] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:19.398222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:19.457811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 275/547] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:19.481997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13265bd3-d9c2-4e6d-8c7b-58aaba81ffff None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:19.485643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:19.588052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13265bd3-d9c2-4e6d-8c7b-58aaba81ffff None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:19.624785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:19.625970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.626393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.626820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.638040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:19.647025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:19.648150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:19.649127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:19.652095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 276/548] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:19.657027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358ebc8-dd56-472b-ae34-a5ed16393f2d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:19.658811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:19.660097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:19.715947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:19.717880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.718967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.719553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.742076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:19.745015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:19.770543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:19.771606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:19.772658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:19.772658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:19.772658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:19.772658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:19.774958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 273/549] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:19.782551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:19.783753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:19.835216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77e628-4f6a-43df-bc4c-6dcfed515ae6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:19.892631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:19.894250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:19.897311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:19.897592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:19.898351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:19.898658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:19.901365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:19.920243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 277/550] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:19.925998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:19.989236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a043e6-a713-46dd-a19c-b0978425b648 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:20.055523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:20.056103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.056393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.056641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.057502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:20.057807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:20.060999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:20.077247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 274/551] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:20.078616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:20.098760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:20.140618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28012f2e-17a2-4ea7-9c04-4f6bdd173e76 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:20.188124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995a1de-391a-4332-a429-e8fe88f0032c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:20.206283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:20.225568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:20.226606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.226940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:20.227186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.227560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.228234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.228675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.229122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.248185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:20.251530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:20.255360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:20.257088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:20.274372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:20.275324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:20.276298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:20.282789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:20.283643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:20.284499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:20.284499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:20.284499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:20.284499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:20.284499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 278/553] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:20.285156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 275/553] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:04:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:20.287078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:20.290690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:20.459092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:20.500660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ceb706-1669-4010-9f6a-436a6bd704f2 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:20.509259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e269b27-d158-4990-a1eb-3f5c02114127 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:20.562126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:20.562719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.563003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.563280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.564010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:20.564320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:20.565816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:20.591023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 276/554] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:20.596912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:20.597887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.598094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:20.598654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.599123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.600188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:20.600693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:20.602370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:20.642121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 279/555] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:04:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:20.647913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:20.722523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:20.791486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988b32-024c-4485-91b7-22ca8e7df289 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:20.835642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:20.836357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.836639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.836913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.854058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:20.855520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:20.858578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1f27c-47f2-4137-8473-a69e71760a9f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:20.863216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:20.881723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:20.882700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:20.884082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:20.898423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 277/556] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:20.904694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:20.921659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073caa27-ba95-4ec1-8300-77d60a2e6fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:20.922844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073caa27-ba95-4ec1-8300-77d60a2e6fea None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.923335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073caa27-ba95-4ec1-8300-77d60a2e6fea None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.923955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073caa27-ba95-4ec1-8300-77d60a2e6fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.936556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073caa27-ba95-4ec1-8300-77d60a2e6fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:20.938469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073caa27-ba95-4ec1-8300-77d60a2e6fea None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-073caa27-ba95-4ec1-8300-77d60a2e6fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:20.958877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:20.959803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:20.960761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:20.960761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:20.960761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:20.960761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:20.968102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 280/557] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:20.970083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c421f1e-86ce-4f87-969a-c3da48952cbe None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:20.970585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c421f1e-86ce-4f87-969a-c3da48952cbe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:20.971137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c421f1e-86ce-4f87-969a-c3da48952cbe None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:20.977016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 281/558] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:20.978095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c421f1e-86ce-4f87-969a-c3da48952cbe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.023536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83d1db7-d7d1-4cd1-8e7c-4fa18440c258 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.066565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915a1a8-8ef0-40c5-ab79-a8948f71a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.067238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915a1a8-8ef0-40c5-ab79-a8948f71a83d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.067520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915a1a8-8ef0-40c5-ab79-a8948f71a83d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.067797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915a1a8-8ef0-40c5-ab79-a8948f71a83d None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.068636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915a1a8-8ef0-40c5-ab79-a8948f71a83d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:21.068948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915a1a8-8ef0-40c5-ab79-a8948f71a83d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:21.070405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915a1a8-8ef0-40c5-ab79-a8948f71a83d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:21.089287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 278/559] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 18 06:04:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:21.090546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce26f8-dab6-4217-a843-16e335c4fbda None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.090837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce26f8-dab6-4217-a843-16e335c4fbda None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.091113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce26f8-dab6-4217-a843-16e335c4fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.095613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.108869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c421f1e-86ce-4f87-969a-c3da48952cbe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.110305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d4ce26f8-dab6-4217-a843-16e335c4fbda None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:21.111515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d4ce26f8-dab6-4217-a843-16e335c4fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:21.146027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b16b0f-7c3b-4a15-8841-5950c46658cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.146705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b16b0f-7c3b-4a15-8841-5950c46658cd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.146952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b16b0f-7c3b-4a15-8841-5950c46658cd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.147226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b16b0f-7c3b-4a15-8841-5950c46658cd None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.147941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b16b0f-7c3b-4a15-8841-5950c46658cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:21.148242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b16b0f-7c3b-4a15-8841-5950c46658cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:21.149872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b16b0f-7c3b-4a15-8841-5950c46658cd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:21.166792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 282/560] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:21.166792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d25f32-e950-43b3-90f2-9b0ac320204e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.166792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d25f32-e950-43b3-90f2-9b0ac320204e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.166792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d25f32-e950-43b3-90f2-9b0ac320204e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.166792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 283/561] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:21.166792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d25f32-e950-43b3-90f2-9b0ac320204e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.174323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.201239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 279/562] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:21.201239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce26f8-dab6-4217-a843-16e335c4fbda None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.288491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d25f32-e950-43b3-90f2-9b0ac320204e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.299441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce26f8-dab6-4217-a843-16e335c4fbda None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.327934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485270a-83e1-4f2c-9df4-ac70cbb41914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.328578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485270a-83e1-4f2c-9df4-ac70cbb41914 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.328861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485270a-83e1-4f2c-9df4-ac70cbb41914 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.329216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485270a-83e1-4f2c-9df4-ac70cbb41914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.338297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40dfe3f-629e-4e13-88d0-7e0cf79f6975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.342503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dfe3f-629e-4e13-88d0-7e0cf79f6975 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.342503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dfe3f-629e-4e13-88d0-7e0cf79f6975 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.342503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40dfe3f-629e-4e13-88d0-7e0cf79f6975 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.346887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dfe3f-629e-4e13-88d0-7e0cf79f6975 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:21.347658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.348342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40dfe3f-629e-4e13-88d0-7e0cf79f6975 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d40dfe3f-629e-4e13-88d0-7e0cf79f6975 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:21.362070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:21.363088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:21.364034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 280/563] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:21.364904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcccc2-f892-4f02-aa58-4e93c2873091 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.365186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcccc2-f892-4f02-aa58-4e93c2873091 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.365462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcccc2-f892-4f02-aa58-4e93c2873091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.384156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-00fcccc2-f892-4f02-aa58-4e93c2873091 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:21.388830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-00fcccc2-f892-4f02-aa58-4e93c2873091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:21.405588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485270a-83e1-4f2c-9df4-ac70cbb41914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:21.407049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485270a-83e1-4f2c-9df4-ac70cbb41914 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:21.430035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.456478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 281/564] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:21.457370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcccc2-f892-4f02-aa58-4e93c2873091 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.511068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 284/565] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:21.512398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02103ae9-b220-46f9-bad8-e0268967589e None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.512693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02103ae9-b220-46f9-bad8-e0268967589e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.512963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02103ae9-b220-46f9-bad8-e0268967589e None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.514688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 285/566] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:21.515378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02103ae9-b220-46f9-bad8-e0268967589e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.566907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.579717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcccc2-f892-4f02-aa58-4e93c2873091 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.614304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.614930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.615214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.615493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.618008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02103ae9-b220-46f9-bad8-e0268967589e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.626305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:21.633976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:21.635057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 282/567] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:21.641194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.651833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a884a3-362c-4b99-be20-b60c411cff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.652483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a884a3-362c-4b99-be20-b60c411cff90 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.652764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a884a3-362c-4b99-be20-b60c411cff90 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.653067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a884a3-362c-4b99-be20-b60c411cff90 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.653930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a884a3-362c-4b99-be20-b60c411cff90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:21.654274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a884a3-362c-4b99-be20-b60c411cff90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:21.655701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a884a3-362c-4b99-be20-b60c411cff90 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:21.667902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 286/568] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:21.669176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb30ce-e341-495e-9345-d73d59067f70 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.670013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb30ce-e341-495e-9345-d73d59067f70 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.670265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb30ce-e341-495e-9345-d73d59067f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.671500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.687850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-78fb30ce-e341-495e-9345-d73d59067f70 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:21.689094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-78fb30ce-e341-495e-9345-d73d59067f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:21.737855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601aaa5-2644-488f-a0e9-2b6025109c42 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.802264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.802580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 287/569] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:21.803062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.803339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.803446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb30ce-e341-495e-9345-d73d59067f70 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.803617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.826634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:21.834311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:21.835214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 283/570] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:21.836419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.847032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.907866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb30ce-e341-495e-9345-d73d59067f70 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.933733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:21.939594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcab1850-7d45-4ce0-881c-29004cd6c338 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:21.943890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.946721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.946721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.946721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.955390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:21.956860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:21.975034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:21.975722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:21.975967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:21.976955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:21.977858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:21.977858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:21.977858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:21.977858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:21.978097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:21.978097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:21.978097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:21.978097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:21.978345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 288/571] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:21.978345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:21.978670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:21.992781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 284/572] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:21.992781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.073218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.082798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1785de-9bf7-4f4b-9779-5aff957d3f54 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.094392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6e295-6ace-43a7-ba74-d0b8b75b50de None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.116279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.117183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.117471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.117737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/065014e1d5984a3db142381ccc62a420/roles/9ff6030cc666452ea3f178662d71993d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.128438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.129265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.129552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.129826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.132391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=065014e1d5984a3db142381ccc62a420, role_id=9ff6030cc666452ea3f178662d71993d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.133883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.140933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:22.148703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:22.149803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:22.150664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 285/573] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:22.151353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.171977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.206934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 289/574] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:21 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/065014e1d5984a3db142381ccc62a420/roles/9ff6030cc666452ea3f178662d71993d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:22.207766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.263128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80122-8db9-4d51-a452-68e985d68a41 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.307965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.308676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.309467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.309749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.312273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:22.312714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.314469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.332359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 286/575] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:22.332359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.335749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c44cc57-46eb-46d0-bcad-0b5ba5a1a70b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.376382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.377087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.377377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.377660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.378399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:22.378763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.380116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.389986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.393234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 290/576] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:22.394033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.437445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.457845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1311ac-f2ef-4edb-824c-7fa893876d88 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.493018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.493875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.494760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.495104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.504670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6ce79-b084-4f84-b88f-7eb52c79cba7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.507353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.508827 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:22.527437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:22.528395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:22.529397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:22.529397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:22.529397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:22.529397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:22.533435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 287/577] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:22.534377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.542091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.542789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.543076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.543353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.544099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:22.544947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.546668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.555810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 291/578] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:22.557908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.623610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.646048 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878176-8a25-4d89-903a-980647a4398f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.668864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e4882c-7eda-4914-a7d0-8a9fe17390de None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.683496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.691103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.691843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.692130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.692851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.704573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.712345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.712450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.712450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.712450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.712450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.716159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.718630 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:22.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:22.725367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:22.726222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:22.726222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:22.726222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:22.726222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:22.726222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 288/579] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:22.726484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:22.739551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:22.740667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 292/580] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:22.741611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.839650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435c1da1-4d31-4c57-8a3d-3d646cf7cb73 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.865921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93f10-0563-4794-8750-fce1861e863c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:22.879271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.879944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.880230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.880515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.881259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:22.881569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.882942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.895011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.895686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 289/581] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:22.897908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:22.909817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:22.910615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:22.910898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:22.911171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:22.925026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:22.927099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:22.946652 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:22.951249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:22.952129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:22.953058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:22.953058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:22.953058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:22.953058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:22.953058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 293/582] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:22.954058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.015600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7838092-e6ff-439d-8062-88aee9d7ec37 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.055725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.056795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.057328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.057862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.058070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84355f-2b09-43ae-bd9c-1a02a6c6540b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.058992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:23.059528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.061256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.073211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 290/583] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:23.074372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.098877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.099529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.099810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.100086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.101288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:23.101288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.102649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.114493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 294/584] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:23.115474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.152782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:23.190902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f368b8-1ef8-45f3-b932-bf31f14c71e4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.193300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:23.223269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d9408-32fa-401a-88b6-12f5b1995b65 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.227920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.228699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.229391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.230014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.239140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.240591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:23.255386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:23.256432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 291/585] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:23.257427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.266821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.267794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.267794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.268012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.268710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:23.269052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.270412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.288389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 295/586] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:23.288389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.379432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811892d6-bbdc-4bd2-98ff-dbd2fdc32144 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.390651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:23.397413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ce666-e9a8-4822-9dbf-c2b5a354f67b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.416695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.417573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.417858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.418143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.429512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.431147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.432218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.432874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.433238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.433522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.434678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=77c35cc610c74f66bc2625dd37dcefe7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:23.435479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.437038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.443548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 296/587] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/role_assignments?user.id=77c35cc610c74f66bc2625dd37dcefe7&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:23.444404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:23.448968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:23.449955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:23.451888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 292/588] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:23.452507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.486314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:23.583062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c76b62-39ec-4844-8c62-b82b130ce1fc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.589983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294a6f0-583e-45ec-a63f-a5bd2eba919f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.636264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.637080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.637376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.637661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.639527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:23.639844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.641760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.642199 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.643206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.643643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.644066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.654694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.656219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.661635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 297/589] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:23.662641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:23.674472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:23.675704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:04:23.676664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:23.678730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 293/590] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:23.679915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.689272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:23.807625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f74cd-79f8-40e9-9e94-2875bb2dd64a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.829016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:23.846671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd2580-52a0-4f75-b3b0-9eae7bb82e76 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:23.848808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.849011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.849429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.849847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.850824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:23.851291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.852858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.877781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 298/591] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:23.879118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.883965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:23.884774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:23.885166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:23.885458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:23.897559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:23.898855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:23.917634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:23.918720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:23.920206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:23.920206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:23.920206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:23.920206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:23.924084 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 294/592] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:23.925106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:23.968766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.006496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10beb981-96b1-4ef1-8cf3-ac5ac449b7e9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.048434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86308f79-59d2-40ee-b77d-09b27edab35b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.050939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.052003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.052003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.052219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.053030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:24.053345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.055037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.079022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 299/593] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:24.080388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.095010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.095826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.096112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.096389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.099664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.109308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.110776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:24.129493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:24.130597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:24.131865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:24.131865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:24.131865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:24.131865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:24.131865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 295/594] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:24.131865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.213326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9966eb5-e658-47cf-94fe-8b70a9a23915 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.256391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.258167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1452a-679a-4f63-853e-c582ccc29926 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.262342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.268263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.268263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.268263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.268263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:24.268263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.268263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.279108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 300/595] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:24.280194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.301546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b7972-8ba4-4fc8-be7f-751386d20348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.302346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7972-8ba4-4fc8-be7f-751386d20348 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.302631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7972-8ba4-4fc8-be7f-751386d20348 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.302911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b7972-8ba4-4fc8-be7f-751386d20348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.315315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b7972-8ba4-4fc8-be7f-751386d20348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.316794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b7972-8ba4-4fc8-be7f-751386d20348 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ad6b7972-8ba4-4fc8-be7f-751386d20348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:24.334960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:24.336018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:24.337128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:24.337128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:24.337128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:24.337128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:24.340745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 296/596] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:24.342137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e553-19f7-4958-ac3e-bb22fa7f1d9b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.342429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e553-19f7-4958-ac3e-bb22fa7f1d9b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.342716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740e553-19f7-4958-ac3e-bb22fa7f1d9b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.344168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 297/597] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:24.344756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e553-19f7-4958-ac3e-bb22fa7f1d9b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.392004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.401450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d5e3fb-5585-4729-99c0-99582f5f7453 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.438493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.439236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.439601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.439945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.440708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:24.441039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.442405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.459218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 301/598] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:24.459416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740e553-19f7-4958-ac3e-bb22fa7f1d9b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.459515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.495704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9ef4b-3490-4b19-bee0-7399f1a0f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.496608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9ef4b-3490-4b19-bee0-7399f1a0f34a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.496966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9ef4b-3490-4b19-bee0-7399f1a0f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.497343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9ef4b-3490-4b19-bee0-7399f1a0f34a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.506329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9ef4b-3490-4b19-bee0-7399f1a0f34a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.507851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9ef4b-3490-4b19-bee0-7399f1a0f34a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.513026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e1d9ef4b-3490-4b19-bee0-7399f1a0f34a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:24.522366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:24.529566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 298/599] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320743f-a061-404b-a7b0-3ed59aea1f17 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.530644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320743f-a061-404b-a7b0-3ed59aea1f17 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.531356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320743f-a061-404b-a7b0-3ed59aea1f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.547561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5320743f-a061-404b-a7b0-3ed59aea1f17 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:24.548879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5320743f-a061-404b-a7b0-3ed59aea1f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:24.574757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48505c3-e373-4ad8-a295-61b4a633ceae None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.619050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.619694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.619983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.620262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.621027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:24.621346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.623307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.626411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 299/600] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:24.627513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320743f-a061-404b-a7b0-3ed59aea1f17 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.648305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 302/601] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:24.648305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.665698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.740905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320743f-a061-404b-a7b0-3ed59aea1f17 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.760402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72bc2f-1e1a-41cc-9660-07337688520f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.774463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.779798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.780675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.781063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.781782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.788439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.795006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.796779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.797560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.797957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.798330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.799214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:24.799692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.801215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:24.803948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:24.805391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:24.806497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:24.810912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 300/602] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:24.812110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.822923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 303/603] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:24.822923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.909827 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:24.920020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bd965e-2410-4c07-8f55-5ea1a6496d5c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.931850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c36d7-49d1-4af7-b740-f9bb021883c7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:24.956209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.957030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.957321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.957598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.968163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:24.969122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:24.969901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:24.970190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:24.970468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:24.975849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:24.976775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:24.977662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 301/604] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:24.978980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:24.983867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:24.985373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:25.001756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:25.002664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:25.003548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 304/605] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:25.004722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:25.038805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:25.093640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a9499a-6745-48d4-8f4b-f11763d8344b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.113984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c303fef-8bfc-4cd9-908b-7862e71344ed None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.131011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.131675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.131962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.132236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.133058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:25.133371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.134799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.148552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 302/606] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:25.152788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.154446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.154734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.154994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:25.155113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/aff4923457aa4be498f954c73f4d0018/roles/9ff6030cc666452ea3f178662d71993d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.168051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:25.172960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=aff4923457aa4be498f954c73f4d0018, role_id=9ff6030cc666452ea3f178662d71993d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.174437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.255590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2f9d7-cadb-4b19-8a5d-d3e66bdf84e0 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.288095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 305/607] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:25 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/aff4923457aa4be498f954c73f4d0018/roles/9ff6030cc666452ea3f178662d71993d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:25.288919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:25.299078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.300626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.301335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.301758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.302743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:25.303195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.305363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.329202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 303/608] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:25.330166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:25.394730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:25.415068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950cadd-0601-4d22-811d-6468c4ddbd42 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.448221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:25.457638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.458556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.459319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.459601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.460813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:25.461173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.462986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.482296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 306/609] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:25.483267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:25.492476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef10a1-0623-47ee-80ef-32c78fe8794b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.538146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.539041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.539368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.539647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/81aa1b5c138247b9b7e0d65fb12af27a/roles/9ff6030cc666452ea3f178662d71993d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.556362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=81aa1b5c138247b9b7e0d65fb12af27a, role_id=9ff6030cc666452ea3f178662d71993d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.558049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.607912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba784374-ba0e-4bf0-9453-3061fa70e20c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.641096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ffcc9-4a1a-4773-bc42-ea70480285b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.641936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ffcc9-4a1a-4773-bc42-ea70480285b5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.642220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ffcc9-4a1a-4773-bc42-ea70480285b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.642495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ffcc9-4a1a-4773-bc42-ea70480285b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.653353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ffcc9-4a1a-4773-bc42-ea70480285b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.655899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ffcc9-4a1a-4773-bc42-ea70480285b5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.658207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:25.662287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 304/610] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:25 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/81aa1b5c138247b9b7e0d65fb12af27a/roles/9ff6030cc666452ea3f178662d71993d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:25.665369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9c8ffcc9-4a1a-4773-bc42-ea70480285b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:25.680030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:25.681193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:25.682300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:25.682300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:25.682300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:25.682300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:25.688729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 307/611] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:25.688729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987cb2-68bc-4da9-8db7-49b6cbea2ab0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.688729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987cb2-68bc-4da9-8db7-49b6cbea2ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.688729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d987cb2-68bc-4da9-8db7-49b6cbea2ab0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.690027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 308/612] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:25.691066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d987cb2-68bc-4da9-8db7-49b6cbea2ab0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:25.835828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d987cb2-68bc-4da9-8db7-49b6cbea2ab0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.837225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23cbf-68df-47c0-ab0d-0d0146fea0c4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:25.868955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:25.880084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b392434-b511-4b0b-b076-c6ac87a693b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.880757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392434-b511-4b0b-b076-c6ac87a693b4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.882385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392434-b511-4b0b-b076-c6ac87a693b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.882385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b392434-b511-4b0b-b076-c6ac87a693b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.882385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b392434-b511-4b0b-b076-c6ac87a693b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:25.882591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b392434-b511-4b0b-b076-c6ac87a693b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.883864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b392434-b511-4b0b-b076-c6ac87a693b4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.883978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:25.884783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.885186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.885746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/f44e152499fc494085c738c67d0397f0/roles/9ff6030cc666452ea3f178662d71993d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.898050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 309/613] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:25.899194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027394a-825d-4502-af6e-e8af6e2a6bcc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:25.899484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027394a-825d-4502-af6e-e8af6e2a6bcc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:25.899762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027394a-825d-4502-af6e-e8af6e2a6bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:25.914433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=f44e152499fc494085c738c67d0397f0, role_id=9ff6030cc666452ea3f178662d71993d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:25.916243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:25.921095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a027394a-825d-4502-af6e-e8af6e2a6bcc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:25.922426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a027394a-825d-4502-af6e-e8af6e2a6bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:25.976293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:25.996162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 310/614] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:25.996871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027394a-825d-4502-af6e-e8af6e2a6bcc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:26.000729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 305/615] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:25 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/f44e152499fc494085c738c67d0397f0/roles/9ff6030cc666452ea3f178662d71993d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:26.026743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:26.151298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027394a-825d-4502-af6e-e8af6e2a6bcc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:26.197025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:26.198232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:26.199092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:26.199579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:26.208968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:26.210909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:26.230537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:26.231529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:26.233102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:26.238889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 311/616] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:04:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:26.241196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:26.288005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ab635-a2c0-495a-bce9-2f5fba77b52d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:26.302073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:26.333759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:26.334575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:26.334861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:26.335137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:26.363266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:26.371151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:26.372058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:26.373481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 306/617] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:26.379584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:26.398719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc709bc8-ff87-4ea2-b07f-f3c333942acf None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:26.459168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:26.469283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:26.473511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:26.473511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:26.473511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:26.473511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:26.473511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:26.473511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:26.508147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 312/618] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:04:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:26.516019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:26.551876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429d7907-d6a6-491b-9965-a5978dcf30f8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:26.622833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:26.623365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:26.623572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:26.623851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:26.624605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:26.624911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:26.626325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:26.644679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 307/619] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:26.650037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:26.659594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4706f69-bd40-4c0e-893c-5c8fd2d47b0f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:26.661528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:26.697339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:26.698358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:26.698896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:26.699383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:26.772550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:26.774382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:26.846218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:26.857567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f673f38-4294-430c-9e77-be9debe4ba9c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:26.882498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 313/620] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:04:26.890750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:26.891396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:26.936041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:26.936841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:26.937159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:26.937438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:26.959886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:26.961389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:26.991368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:26.992341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:26.993246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:26.993246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:26.993246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:26.993246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:26.993246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 308/621] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:27.006677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.100081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f3449-4f09-4e21-9f67-2e070a4ef513 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.143604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.144733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.145049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.145331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.157715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:27.159193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:27.180639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:27.181661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:27.182624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:27.182624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:27.182624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:27.182624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:27.187449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 314/622] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:27.188743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.253047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:27.267674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab954-b2c9-45e3-a0d7-fa7d876ac50a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.343283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee3accb-05fc-4329-a2d2-26e1d4c3b692 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.345431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.346193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.346481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.346761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.347493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:27.347805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:27.349291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:27.364780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 309/623] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:27.369525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.379753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:27.410447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.411479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.411995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.412486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.413476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:27.413989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:27.415599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:27.429514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 315/624] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:27.445587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.493138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d4ac5-ca23-41a6-b76a-a90f249138b6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.533220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.534032 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.534323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.534607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.549010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:27.549010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:27.566496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:27.567514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 310/625] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:27.568466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.629523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f5264-8c53-4b67-96be-659978d43adc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.640509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:27.645352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:27.666390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465d86b-1bbd-4f0f-8a49-7d8f9cabe9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.667192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465d86b-1bbd-4f0f-8a49-7d8f9cabe9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.667479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465d86b-1bbd-4f0f-8a49-7d8f9cabe9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.667754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465d86b-1bbd-4f0f-8a49-7d8f9cabe9f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.674985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec51a2-c556-40b2-aad9-0d5bd14b66c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.675254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465d86b-1bbd-4f0f-8a49-7d8f9cabe9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:27.676652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465d86b-1bbd-4f0f-8a49-7d8f9cabe9f6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1465d86b-1bbd-4f0f-8a49-7d8f9cabe9f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:27.691270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:27.693215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 316/626] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d5e6d-eb4a-4efa-9768-36e8abec9279 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.695285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d5e6d-eb4a-4efa-9768-36e8abec9279 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.696541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d5e6d-eb4a-4efa-9768-36e8abec9279 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.696541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 317/627] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:27.702022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b386a-81bd-4b58-bc35-235fe38699ba None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.702368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b386a-81bd-4b58-bc35-235fe38699ba None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.702690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b386a-81bd-4b58-bc35-235fe38699ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.720208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.720924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.721106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-198b386a-81bd-4b58-bc35-235fe38699ba None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:27.721249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.721585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.722395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-198b386a-81bd-4b58-bc35-235fe38699ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:27.722580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:27.722721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:27.724284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:27.744042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 311/628] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:27.745047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.805314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 318/629] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:27.806256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b386a-81bd-4b58-bc35-235fe38699ba None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.865857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be005237-2a7e-4c3a-92a1-aa444c87e1dd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.905379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:27.911111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.911783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.912072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.912353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:27.913648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:27.913970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:27.921632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:27.937007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 312/630] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:27.937007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:27.945984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b386a-81bd-4b58-bc35-235fe38699ba None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:27.949558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:27.990407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:27.991212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:27.991504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:27.991930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.003982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.005960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:28.025663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:28.026615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:28.027604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:28.027604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:28.027604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:28.027604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:28.030279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 319/631] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:28.031560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.060179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807de2b-73b3-4ce2-8e3f-2c54827a9dbc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.098659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.099812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.100254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.100678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.113369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:28.121858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:28.122829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:28.123657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 313/632] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:28.125424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.153299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbfe10-1053-4681-9749-33ed4a9c44b3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.175828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:28.193789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316be8d6-af4b-495b-9878-cd1c46ef0e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.194446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316be8d6-af4b-495b-9878-cd1c46ef0e01 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.194729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316be8d6-af4b-495b-9878-cd1c46ef0e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.195046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316be8d6-af4b-495b-9878-cd1c46ef0e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.195900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316be8d6-af4b-495b-9878-cd1c46ef0e01 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=065014e1d5984a3db142381ccc62a420) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:28.196389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316be8d6-af4b-495b-9878-cd1c46ef0e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.197799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316be8d6-af4b-495b-9878-cd1c46ef0e01 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.211899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 320/633] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/role_assignments?user.id=065014e1d5984a3db142381ccc62a420&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:28.211899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ec2ba-f696-4739-8ce1-f4fe0de6db8d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.211899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ec2ba-f696-4739-8ce1-f4fe0de6db8d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.211899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4ec2ba-f696-4739-8ce1-f4fe0de6db8d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.211899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 321/634] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:28.211899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ec2ba-f696-4739-8ce1-f4fe0de6db8d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.239250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:28.252875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a25c96-b080-4b00-bb26-96c42f7ea963 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.307809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc2f2ea-5536-4dfe-a2c7-845b2d80654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.308732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f2ea-5536-4dfe-a2c7-845b2d80654d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.309291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f2ea-5536-4dfe-a2c7-845b2d80654d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.309951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc2f2ea-5536-4dfe-a2c7-845b2d80654d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.311499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f2ea-5536-4dfe-a2c7-845b2d80654d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:28.312016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f2ea-5536-4dfe-a2c7-845b2d80654d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.313700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc2f2ea-5536-4dfe-a2c7-845b2d80654d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.328822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 314/635] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:28.330550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d765b-60db-4027-a0d2-3d736cb19f7d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.331042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d765b-60db-4027-a0d2-3d736cb19f7d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.331524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d765b-60db-4027-a0d2-3d736cb19f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.349749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6f6d765b-60db-4027-a0d2-3d736cb19f7d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:28.351856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6f6d765b-60db-4027-a0d2-3d736cb19f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:28.366147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4ec2ba-f696-4739-8ce1-f4fe0de6db8d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.413961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.414648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.414933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.415210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.415973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:28.416282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.418767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.430324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 322/636] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:28.430324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.444423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 315/637] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:28.445825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d765b-60db-4027-a0d2-3d736cb19f7d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.490053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:28.528367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:28.553545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1efb15b-9310-4c5d-8e4c-44beaf5538ac None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.564423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d765b-60db-4027-a0d2-3d736cb19f7d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.590990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad9b38-a9e1-40ab-8656-f6bc90e8414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.592473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9b38-a9e1-40ab-8656-f6bc90e8414f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.592763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9b38-a9e1-40ab-8656-f6bc90e8414f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.593066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad9b38-a9e1-40ab-8656-f6bc90e8414f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.600496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9b38-a9e1-40ab-8656-f6bc90e8414f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.601437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.602077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad9b38-a9e1-40ab-8656-f6bc90e8414f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.602452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.602726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.603070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.615129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.616564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-98ad9b38-a9e1-40ab-8656-f6bc90e8414f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:28.617439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:28.618307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 323/638] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b33cf-c4a7-4277-8bcd-8e5f8e94f80b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.624436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b33cf-c4a7-4277-8bcd-8e5f8e94f80b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.625525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b33cf-c4a7-4277-8bcd-8e5f8e94f80b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.625525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 324/639] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:28.625525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b33cf-c4a7-4277-8bcd-8e5f8e94f80b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:28.643545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:28.644658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:28.645596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:28.645596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:28.645596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:28.645596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:28.645596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 316/640] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:28.645596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.744649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:28.745385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b33cf-c4a7-4277-8bcd-8e5f8e94f80b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.759414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a430b1a-cd3c-4e49-af1c-9a6161c83b39 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.782148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13611536-36a1-4fd0-94aa-56058b138a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.782947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13611536-36a1-4fd0-94aa-56058b138a6b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.783235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13611536-36a1-4fd0-94aa-56058b138a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.783515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13611536-36a1-4fd0-94aa-56058b138a6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.796100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13611536-36a1-4fd0-94aa-56058b138a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:28.801060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.801723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.802005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.802283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.803070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:28.803378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-13611536-36a1-4fd0-94aa-56058b138a6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:28.805044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:28.806227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:28.807335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:28.808120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.808625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 325/641] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:28.809922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a802-4c2a-4ec4-9c97-26d58f02a59f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.810312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a802-4c2a-4ec4-9c97-26d58f02a59f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.810537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479a802-4c2a-4ec4-9c97-26d58f02a59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.817493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:28.826329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 317/642] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:28.826329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.832795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b479a802-4c2a-4ec4-9c97-26d58f02a59f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:28.834739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b479a802-4c2a-4ec4-9c97-26d58f02a59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:28.913766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 326/643] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:28.914763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a802-4c2a-4ec4-9c97-26d58f02a59f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:28.936516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1fc4d2-c834-4a6e-9981-e86e6df6a3fb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:28.972743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:28.973442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:28.973725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:28.974000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:28.974718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:28.975021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:28.976402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:28.988571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 318/644] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:28.989483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.002087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.029361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479a802-4c2a-4ec4-9c97-26d58f02a59f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.063096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.069190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.071700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.071700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.071700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.071700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:29.071700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.073287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.087238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 327/645] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:29.087238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.108691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfede6de-0105-48b1-8dd4-f92f4e5106c8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.150771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.151935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.152372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.152787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/77c35cc610c74f66bc2625dd37dcefe7/roles/9ff6030cc666452ea3f178662d71993d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.169862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=77c35cc610c74f66bc2625dd37dcefe7, role_id=9ff6030cc666452ea3f178662d71993d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.171408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.196794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d465a-693c-49e3-9e15-ca6034d38da2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.232068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.232852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.233170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.233447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.242935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 319/646] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:28 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/77c35cc610c74f66bc2625dd37dcefe7/roles/9ff6030cc666452ea3f178662d71993d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:29.244019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.255051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:29.263946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:29.273207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 328/647] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:29.274219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.338403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.345537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.396387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa8726-1711-4a9a-932d-95bf4862e0e1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.408579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474dddd6-0755-41c0-b3cd-ae40cf6a00c5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.444114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.445263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.445747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.446053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.455737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.457271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.461412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.462494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.463004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.463484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:29.476771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:29.478012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 06:04:29.478959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:29.479501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.479574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 320/648] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:29.479653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.479744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:29.499113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:29.500074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:29.500972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:29.500972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:29.500972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:29.500972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:29.505295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 329/649] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:29.506274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.594680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5233de0-3934-42cf-b969-9fc7952afb20 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.612096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.619292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d47da-0644-4bd2-9ddc-67d7ebc0302d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.627081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.631993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.632671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.632955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.633280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.634032 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:29.634342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.635759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.645856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 321/650] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:29.646720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.664280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.665059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.665485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.665768 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.666744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:29.667126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.668647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.690876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 330/651] 10.222.0.27 () {56 vars in 1139 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:29.691802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.761982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226ff66-2df1-41ac-9641-5cf2bad33dea None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.801890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.802563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.802848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.803121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.803225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c0de1-efb4-4088-aa25-6241c56fd325 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.803845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:29.804404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.806996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.822274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 322/652] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:29.823515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.848046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.849444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.850233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.850700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:29.864297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:29.866237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:29.876066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:29.890280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:29.891545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:29.892735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:29.892735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:29.892735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:29.892735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:29.898547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 331/653] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:29.899626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:29.921297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:29.950949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dea636-f5f1-464e-ad1e-845c6cfb0f01 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:29.990079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:29.991092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:29.991528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:29.991957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.010997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d873a-1d43-4118-8752-5d0a8951a539 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.047950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.048818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.049201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.049571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.057665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.059305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.070358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.072102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:30.076120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:30.077126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:30.078627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 332/654] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:30.079324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.119555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.163432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.189189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341f989-555d-4f89-8a10-92cfde7ecc9b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.193141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 323/655] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:30.194430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.227803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.228560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.228971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.229383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.230221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:30.230744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.232812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.249013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 333/656] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:30.249013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.315705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb026b-9507-4fda-b4d5-8b7c36516539 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.358076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.359436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.360167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.360605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.361890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:30.362806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.364940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.368382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602e5f1-f7f6-4c4e-82b1-db4b56c5a9c6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.376432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.391419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 324/657] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:30.393136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.408368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.409341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.409883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.410068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.413807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.425557 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.427179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:30.446513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:30.447629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:30.448720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:30.448720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:30.448720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:30.448720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:30.453280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 334/658] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:30.454408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.526641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b7acb-1ace-49eb-b74a-31cc10490caf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.564439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.565308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.565669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.565991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0595d7c-0d9e-4bf2-97b8-f46589bcceb4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.566105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.573688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.575124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:30.590490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:30.591543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 325/659] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:30.592516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.608085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.608732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.609108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.609393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.652650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.671890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.685517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.687202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.697275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906902a-732f-4693-ab6e-18748838c248 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.736414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763f318-0f88-4558-bd22-a282dafc9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.737115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f318-0f88-4558-bd22-a282dafc9ccc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.737400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f318-0f88-4558-bd22-a282dafc9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.737725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763f318-0f88-4558-bd22-a282dafc9ccc None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.738401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f318-0f88-4558-bd22-a282dafc9ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:30.738711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f318-0f88-4558-bd22-a282dafc9ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.740091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763f318-0f88-4558-bd22-a282dafc9ccc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.760676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 326/660] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:30.760676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0032c-1a42-47ca-8c40-e61853ca7aac None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.760676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0032c-1a42-47ca-8c40-e61853ca7aac None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.760676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0032c-1a42-47ca-8c40-e61853ca7aac None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.760676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 327/661] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:30.760676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0032c-1a42-47ca-8c40-e61853ca7aac None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.797238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 335/662] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:30.798206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:30.878637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0032c-1a42-47ca-8c40-e61853ca7aac None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.897024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.898970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:30.911329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f6d9e-03be-40aa-a5d6-362e366a63e1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:30.920064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65030fb4-a019-49c8-8f98-a0fe05995392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.920746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030fb4-a019-49c8-8f98-a0fe05995392 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.921452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030fb4-a019-49c8-8f98-a0fe05995392 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.921739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65030fb4-a019-49c8-8f98-a0fe05995392 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.922894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65030fb4-a019-49c8-8f98-a0fe05995392 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:30.923351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65030fb4-a019-49c8-8f98-a0fe05995392 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.925092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65030fb4-a019-49c8-8f98-a0fe05995392 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.945158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 328/663] 10.222.0.27 () {56 vars in 1137 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:30.946501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92620-7047-4eb7-a2da-7b9722d4ed76 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.949423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92620-7047-4eb7-a2da-7b9722d4ed76 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.949423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc92620-7047-4eb7-a2da-7b9722d4ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.951727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:30.952515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:30.952803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:30.953108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:30.960890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:30.962365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:30.968144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dbc92620-7047-4eb7-a2da-7b9722d4ed76 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:30.969597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dbc92620-7047-4eb7-a2da-7b9722d4ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:30.976530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:30.977475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 336/664] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:30.983530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.065007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 329/665] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:31.065007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc92620-7047-4eb7-a2da-7b9722d4ed76 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.093898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f8446-e0ce-4480-8ebd-5c9f3a596de8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.128914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.129662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.129956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.130234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.142670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.144153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.154265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:31.166559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:31.173490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:31.174373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:31.174373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:31.174373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:31.174373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:31.174373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 337/666] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:31.174373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.174718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc92620-7047-4eb7-a2da-7b9722d4ed76 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.176072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.210036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.215812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.215812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.215812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.282356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a24e71-f2af-4337-9e1e-98eaf3cd4b5d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.286031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.287486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.320357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.321053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.321344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.321622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.322424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:31.322887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.324336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.338029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 338/667] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:31.343680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.397291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 330/668] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:31.398132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.401125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.409011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.449708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f7d53-cafa-41ba-abe5-4e3b701f0f51 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.485307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.486099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.486384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.486659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.495448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d63c0d4-6b19-47f7-92e2-3e1293a2b5fb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.496649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:31.504279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:31.505263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 339/669] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:31.506317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.535331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0b9af-f22d-40c4-859e-3b8dc4c114a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.536014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b9af-f22d-40c4-859e-3b8dc4c114a4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.536307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b9af-f22d-40c4-859e-3b8dc4c114a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.536583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0b9af-f22d-40c4-859e-3b8dc4c114a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.537345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b9af-f22d-40c4-859e-3b8dc4c114a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:31.537652 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b9af-f22d-40c4-859e-3b8dc4c114a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.539022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0b9af-f22d-40c4-859e-3b8dc4c114a4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.550791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 331/670] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:31.551889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d35d-a8a3-433e-9f75-0ffaf00ee04e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.552188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d35d-a8a3-433e-9f75-0ffaf00ee04e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.552474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011d35d-a8a3-433e-9f75-0ffaf00ee04e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.554525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 332/671] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:31.554956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011d35d-a8a3-433e-9f75-0ffaf00ee04e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.613111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829ee28f-b126-411f-9e32-5b77203761a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.620633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.634190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.648848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.649463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.649767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.650041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.650893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=aff4923457aa4be498f954c73f4d0018) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:31.651209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.652640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.658651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 340/672] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/role_assignments?user.id=aff4923457aa4be498f954c73f4d0018&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:31.659431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.669203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011d35d-a8a3-433e-9f75-0ffaf00ee04e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.713498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.714403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.714691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.714982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.728004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.729537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:31.749365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:31.750519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:31.751717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:31.751717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:31.751717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:31.751717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:31.754786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 333/673] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:31.754786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.782744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaeb39e-9207-41a4-956c-573be2d8c43a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.822770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516780d-768f-40fa-94c4-669a3dc061bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.824472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516780d-768f-40fa-94c4-669a3dc061bd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.824472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516780d-768f-40fa-94c4-669a3dc061bd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.824472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516780d-768f-40fa-94c4-669a3dc061bd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.824750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516780d-768f-40fa-94c4-669a3dc061bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:31.825011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516780d-768f-40fa-94c4-669a3dc061bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.827306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516780d-768f-40fa-94c4-669a3dc061bd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.836534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 341/674] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:31.838010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16108a-59fd-4659-9645-fac408b14153 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.838405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16108a-59fd-4659-9645-fac408b14153 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.838572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16108a-59fd-4659-9645-fac408b14153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.858257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fa16108a-59fd-4659-9645-fac408b14153 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:31.859459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fa16108a-59fd-4659-9645-fac408b14153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:31.874292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601f1ff-9ced-4961-8b10-c493b91b1d79 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:31.892188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.909726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:31.910531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:31.910882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:31.911226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:31.911971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:31.918611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:31.920447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:31.935562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:31.936894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:31.942823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:31.943264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 342/675] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:31.943264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16108a-59fd-4659-9645-fac408b14153 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:31.943619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 334/676] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:31.944385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.051982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769afb60-4b52-4167-9f56-9a4b7f6eece5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.053105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16108a-59fd-4659-9645-fac408b14153 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.087844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.088502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.088785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.089085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.089804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:32.090113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.090917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.091670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.092235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.092702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.093388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.105042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 343/677] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:32.105042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.110232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.111706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:32.131809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:32.132774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:32.133697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:32.133697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:32.133697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:32.133697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:32.133697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 335/678] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:32.133970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.146003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.165426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.216171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa29292-c3e5-4462-85b0-484213553824 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.240187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6200fb85-7c47-4900-aab0-1c92c9d60935 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.252334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.253025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.253314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.253594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.254415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:32.254727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.256157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.273458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 344/679] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:32.273458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.281548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.282348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.282637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.282917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.296959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:32.302114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:32.303009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:32.303843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 336/680] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:32.304809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.383261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.390859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3f37-f7ac-4e0b-981b-76c245819cf3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.403368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.417437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689234d-bef8-4ce1-b3a0-a366189e1c12 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.426437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.427236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.427523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.427872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.436781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.438266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:32.453347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:32.454829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:32.455848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 345/681] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:32.456323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.461516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.461724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.461997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.462353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.463086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:32.463405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.464880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.481139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 337/682] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:32.482678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.572492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73a4c4-e0b6-439e-90f2-47704cbeda97 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.587810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e9bdc-719d-4ed8-8235-004a37316cc7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.608907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.609709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.610093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.610491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.611432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=81aa1b5c138247b9b7e0d65fb12af27a) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:32.611883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.613450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.619798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 346/683] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/role_assignments?user.id=81aa1b5c138247b9b7e0d65fb12af27a&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:32.625253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.638194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.639047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.639454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.639828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.640711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:32.641170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.642851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.652843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 338/684] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:32.654502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.660164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.678257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.774765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0ad83-bb02-477e-9046-994c5c516241 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.793291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c205445-9b2d-47d7-8119-01058a3a8c6b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.829535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.830222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.830507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.830783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.831603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:32.831912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.834475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.838410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:32.839420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:32.839796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:32.840170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:32.849487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 347/685] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:32.850353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.851104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:32.852648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:32.869242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:32.870425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:32.871563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 339/686] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:32.872291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:32.963710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.981439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1d161-bcb2-46ef-8de9-c15b2c16ee6b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:32.984776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:32.999482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c64799-8e76-4aea-b812-81e867062f0b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:33.020680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.022084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.022084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.022368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.033664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.035120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.037367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.038249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.038731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.039207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.040299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=f44e152499fc494085c738c67d0397f0) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:33.040809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.043391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.053017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 340/687] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/role_assignments?user.id=f44e152499fc494085c738c67d0397f0&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:33.054386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:33.055269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:33.056239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:33.056239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:33.056239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:33.056239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:33.056239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 348/688] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:33.057128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:33.063063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:33.174496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca11e20-41ae-43ac-b287-3b867beb2ce4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:33.217099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.217099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.217099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.217099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.217492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:33.217492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.218714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.239826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 349/689] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:04:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:33.241370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:33.249031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:33.308004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd12ef-b83a-4b5b-8f53-d2567351609f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:33.361636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.362323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.362612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.362919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.363905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:33.364213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.365907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.367994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:33.385014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 341/690] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:33.388718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5750abe8-cb56-4c69-be3a-41891e0072f8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:33.393621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:33.440806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.441593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.441882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.442160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.511503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:33.523508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.525416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.557185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9bf82-c4c0-4755-bb14-2f8768273c1b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:33.631402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.632208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.632497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.632774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.646690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.648454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:33.665937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:33.666999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:33.667912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:33.672727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 342/691] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:33.674232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:33.744485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:33.778371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 350/692] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 06:04:33.783990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:33.797937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492ff9e-aa37-439d-b656-662a8475dbed None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:33.842151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fccc28-2cc6-42f1-a9e3-87608afd02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.842835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fccc28-2cc6-42f1-a9e3-87608afd02ea None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.843121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fccc28-2cc6-42f1-a9e3-87608afd02ea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.843400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fccc28-2cc6-42f1-a9e3-87608afd02ea None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.844248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fccc28-2cc6-42f1-a9e3-87608afd02ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:33.844559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fccc28-2cc6-42f1-a9e3-87608afd02ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.846022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fccc28-2cc6-42f1-a9e3-87608afd02ea None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.870679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 343/693] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 18 06:04:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:33.872136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2163d2-6de7-4d35-a386-9a22c51c87ca None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.874965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2163d2-6de7-4d35-a386-9a22c51c87ca None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.874965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2163d2-6de7-4d35-a386-9a22c51c87ca None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.875338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 344/694] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:33.876076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2163d2-6de7-4d35-a386-9a22c51c87ca None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:33.914639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:33.929483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595d4d1-4d63-49d4-96f4-2559c7ae33c7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:33.965921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796cb57f-e745-4f1c-8718-416d36b2b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:33.967431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb57f-e745-4f1c-8718-416d36b2b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:33.967714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb57f-e745-4f1c-8718-416d36b2b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:33.967993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796cb57f-e745-4f1c-8718-416d36b2b5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:33.978576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cb57f-e745-4f1c-8718-416d36b2b5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:33.980030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796cb57f-e745-4f1c-8718-416d36b2b5a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-796cb57f-e745-4f1c-8718-416d36b2b5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:33.999450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:34.001543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:34.003676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:34.003676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:34.003676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:34.003676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:34.004169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2163d2-6de7-4d35-a386-9a22c51c87ca None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.004316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 351/695] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:34.004316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f0ff-0248-41aa-bfce-c564d770685d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.004316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f0ff-0248-41aa-bfce-c564d770685d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.004316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e85f0ff-0248-41aa-bfce-c564d770685d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.020901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0e85f0ff-0248-41aa-bfce-c564d770685d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:34.021239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:34.022180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0e85f0ff-0248-41aa-bfce-c564d770685d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:34.052080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.052725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.053029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.053360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.121123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 352/696] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:34.122022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85f0ff-0248-41aa-bfce-c564d770685d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.150525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.152604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.211626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:34.244672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e85f0ff-0248-41aa-bfce-c564d770685d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.289010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.295685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 345/697] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 06:04:34.295685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.296585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.297093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.297536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.298490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:34.299052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.305786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.313973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:34.321607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 353/698] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:34.327192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.420766 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a9c1b-494e-406f-bf44-e4309a70d9fe None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.452456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fbfafd-a976-4f37-8f5a-fa5418ae5f2d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.468714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.469800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.470228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.470645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] PATH_INFO: `/v3/services/network` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.471440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.473091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.489270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:34.491853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:34.493126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:34.493985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:34.496724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.497031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 346/699] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:34.498884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.504467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.504467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.504467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.516731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.518459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:34.540771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:34.541918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:34.542833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:34.542833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:34.542833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:34.542833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:34.548343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 354/700] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:34.549362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.599648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:34.630742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1eea4-0375-40c3-a5a2-108473233956 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.663280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fc7ce-6bb0-4ffd-937e-f2f008af5777 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.667746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.669233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.670502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.671070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.679501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.681404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.701355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.702086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.702171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.702451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:34.703000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:34.703846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:34.705553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:34.705987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] RBAC: Adding query filter params (name=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:34.705987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.705987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.712790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 347/701] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:34.713208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 355/702] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:34.714213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.715498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.778047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:34.838648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b163f09-0a3b-4043-a86a-3d6e02a5b766 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.847421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51e866-7a62-4cc0-8884-bde6743db186 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:34.882435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.883453 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.883938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.884603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.885552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:34.886076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.890165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.893517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:34.898044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:34.898715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:34.899000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:34.899279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:34.900010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:34.900835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:34.902282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:34.906810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 348/703] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:34.907852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:34.914968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 356/704] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:34.915847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.057967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c62cd-f2ae-4ddd-aceb-73fb70189aba None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:35.078707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:35.109589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deec9bd-0e3c-4ba6-beef-f5d5ff47ae44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:35.110415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deec9bd-0e3c-4ba6-beef-f5d5ff47ae44 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.111863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deec9bd-0e3c-4ba6-beef-f5d5ff47ae44 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.112169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deec9bd-0e3c-4ba6-beef-f5d5ff47ae44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.115828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea54422-fb0f-484b-8090-1264b37c8d65 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:35.121989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deec9bd-0e3c-4ba6-beef-f5d5ff47ae44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:35.124440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deec9bd-0e3c-4ba6-beef-f5d5ff47ae44 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0deec9bd-0e3c-4ba6-beef-f5d5ff47ae44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:35.141640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:35.142667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:35.143749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:35.145255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 357/705] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:35.146297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648a51-6f2b-4200-89e3-1e93630086d9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.146601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648a51-6f2b-4200-89e3-1e93630086d9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.146868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e648a51-6f2b-4200-89e3-1e93630086d9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.148490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 358/706] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:35.154999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9ba9-938f-4827-afbe-48d9c3b895bc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.155284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9ba9-938f-4827-afbe-48d9c3b895bc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.155581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef9ba9-938f-4827-afbe-48d9c3b895bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.168825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:35.170288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.170720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.171166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.172167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:35.172622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:35.174347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:35.180879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b7ef9ba9-938f-4827-afbe-48d9c3b895bc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:35.182310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b7ef9ba9-938f-4827-afbe-48d9c3b895bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:35.194163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 349/707] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:35.195347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.268556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 359/708] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:35.269965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef9ba9-938f-4827-afbe-48d9c3b895bc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.281999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:35.346304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad4f8b-2359-4512-b647-e6b89f27dc21 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:35.394965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:35.396288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.396893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.397623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.399075 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:35.399791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:35.402055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:35.417669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef9ba9-938f-4827-afbe-48d9c3b895bc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:35.423784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 350/709] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:35.423784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.426226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:35.464027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:35.464686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.464972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.465293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.466288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=065014e1d5984a3db142381ccc62a420) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:35.466600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:35.468202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:35.479065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 360/710] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:35 2022] GET /identity/v3/role_assignments?user.id=065014e1d5984a3db142381ccc62a420&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:35.480069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.558721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0005663-5c3f-42f4-b039-3df476500160 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:35.578563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:35.604555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8dedd-4741-4857-bcde-ed7dfb09d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:35.605448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8dedd-4741-4857-bcde-ed7dfb09d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.605740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8dedd-4741-4857-bcde-ed7dfb09d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.606438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8dedd-4741-4857-bcde-ed7dfb09d9a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.618026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddc377-fec0-4842-b91c-377869be81cc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:35.622629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8dedd-4741-4857-bcde-ed7dfb09d9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:35.624133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a8dedd-4741-4857-bcde-ed7dfb09d9a9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-27a8dedd-4741-4857-bcde-ed7dfb09d9a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:35.647469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:35.648434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:35.649410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:35.649410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:35.649410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:35.649410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:35.653123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 351/711] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:35.655554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a204-7b16-4428-913a-2127db5d7cea None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.656040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a204-7b16-4428-913a-2127db5d7cea None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.663199 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6887a204-7b16-4428-913a-2127db5d7cea None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.663199 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 352/712] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:35.663199 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887a204-7b16-4428-913a-2127db5d7cea None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.667345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f21839-890f-40bd-9d32-28ca6b112a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:35.668136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21839-890f-40bd-9d32-28ca6b112a88 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.668488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21839-890f-40bd-9d32-28ca6b112a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.668838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f21839-890f-40bd-9d32-28ca6b112a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.669918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f21839-890f-40bd-9d32-28ca6b112a88 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=77c35cc610c74f66bc2625dd37dcefe7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:35.670322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f21839-890f-40bd-9d32-28ca6b112a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:35.672342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f21839-890f-40bd-9d32-28ca6b112a88 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:35.679895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 361/713] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:35 2022] GET /identity/v3/role_assignments?user.id=77c35cc610c74f66bc2625dd37dcefe7&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:35.681402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d015d-dcde-427e-8b0d-31a5eb586f6d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.681760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d015d-dcde-427e-8b0d-31a5eb586f6d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.682175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d015d-dcde-427e-8b0d-31a5eb586f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.705798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bf8d015d-dcde-427e-8b0d-31a5eb586f6d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:35.707256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bf8d015d-dcde-427e-8b0d-31a5eb586f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:35.745478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:35.839795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 362/714] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:35.864947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d015d-dcde-427e-8b0d-31a5eb586f6d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.879613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6887a204-7b16-4428-913a-2127db5d7cea None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:35.928962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:35.930328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:35.930847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:35.931429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:35.932442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:35.932944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:35.934761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:35.949418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 353/715] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:35.955324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:35.987991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:36.001424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d015d-dcde-427e-8b0d-31a5eb586f6d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:36.048486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:36.049742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:36.050326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:36.050708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:36.051503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:36.053162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:36.070411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:36.071594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:36.072590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:36.074868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 363/716] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 18 06:04:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:36.084725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:36.087421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c821626-dfbf-415c-8533-2cec5a66e3ac None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:36.119428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:36.145839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:36.147059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:36.147546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:36.148482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:36.149524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:36.151619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:36.224375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25c1ed-9b2e-4054-bbbd-a8515a5a6b55 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:36.263241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a63716-473c-4fda-8dbf-a5c87375cc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:36.264114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63716-473c-4fda-8dbf-a5c87375cc47 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:36.264497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63716-473c-4fda-8dbf-a5c87375cc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:36.264894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a63716-473c-4fda-8dbf-a5c87375cc47 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:36.265780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63716-473c-4fda-8dbf-a5c87375cc47 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:36.266192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63716-473c-4fda-8dbf-a5c87375cc47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:36.267689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a63716-473c-4fda-8dbf-a5c87375cc47 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:36.269602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 354/717] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:04:35 2022] POST /identity/v3/users => generated 254 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:36.282148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 364/718] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 18 06:04:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:36.287973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:36.432052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:36.455887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24239c-1f91-4c9f-b028-5a0492da8f1d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:36.529410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071f3a6-5382-4597-aee7-c9c75306def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:36.530274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071f3a6-5382-4597-aee7-c9c75306def2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:36.530841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071f3a6-5382-4597-aee7-c9c75306def2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:36.531177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071f3a6-5382-4597-aee7-c9c75306def2 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:36.531927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071f3a6-5382-4597-aee7-c9c75306def2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:36.532244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071f3a6-5382-4597-aee7-c9c75306def2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:36.533999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c071f3a6-5382-4597-aee7-c9c75306def2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:36.548254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 355/719] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 18 06:04:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:37.158138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16510e-05a0-4076-b9dc-3d586c459b5d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:37.158691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16510e-05a0-4076-b9dc-3d586c459b5d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:37.158691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16510e-05a0-4076-b9dc-3d586c459b5d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:37.160285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 365/720] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:37.165866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28236a-3b00-428c-803e-b64bbd4308ea None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:37.166288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28236a-3b00-428c-803e-b64bbd4308ea None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:37.166484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28236a-3b00-428c-803e-b64bbd4308ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:37.184494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1d28236a-3b00-428c-803e-b64bbd4308ea None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:37.186619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1d28236a-3b00-428c-803e-b64bbd4308ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:37.273813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 356/721] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:37.318687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16510e-05a0-4076-b9dc-3d586c459b5d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:37.441349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:37.461358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16510e-05a0-4076-b9dc-3d586c459b5d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:37.509393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b069c2-d9b1-4764-a0a3-bc99362bdd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:37.510071 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b069c2-d9b1-4764-a0a3-bc99362bdd4e None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:37.510356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b069c2-d9b1-4764-a0a3-bc99362bdd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:37.510634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b069c2-d9b1-4764-a0a3-bc99362bdd4e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:37.511367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b069c2-d9b1-4764-a0a3-bc99362bdd4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:37.512739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b069c2-d9b1-4764-a0a3-bc99362bdd4e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:37.630708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 366/722] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:04:37 2022] POST /identity/v3/services => generated 240 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:37.937496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a4835-09c6-4d99-82c2-c62b190e7f5d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:37.937927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a4835-09c6-4d99-82c2-c62b190e7f5d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:37.938106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57a4835-09c6-4d99-82c2-c62b190e7f5d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:37.939700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 357/723] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:37.945536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6ccb-5fb7-4727-b3ea-234fbc256261 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:37.945828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6ccb-5fb7-4727-b3ea-234fbc256261 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:37.946113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d6ccb-5fb7-4727-b3ea-234fbc256261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:37.964358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a12d6ccb-5fb7-4727-b3ea-234fbc256261 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:37.965625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a12d6ccb-5fb7-4727-b3ea-234fbc256261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:38.046317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 367/724] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:37 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 06:04:38.069180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a4835-09c6-4d99-82c2-c62b190e7f5d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:38.176051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:38.233772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57a4835-09c6-4d99-82c2-c62b190e7f5d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:38.310603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:38.311450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:38.311701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:38.312677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:38.339311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:38.347620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:38.348529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:38.349363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:38.354024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 358/725] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:38.355169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d6ccb-5fb7-4727-b3ea-234fbc256261 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:38.483760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:38.513536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d6ccb-5fb7-4727-b3ea-234fbc256261 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:38.582924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb006676-d9bc-41b0-adb2-d2f54f2d532b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:38.583622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006676-d9bc-41b0-adb2-d2f54f2d532b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:38.583897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006676-d9bc-41b0-adb2-d2f54f2d532b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:38.584455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb006676-d9bc-41b0-adb2-d2f54f2d532b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:38.585277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb006676-d9bc-41b0-adb2-d2f54f2d532b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:38.585584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb006676-d9bc-41b0-adb2-d2f54f2d532b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:38.587047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb006676-d9bc-41b0-adb2-d2f54f2d532b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:38.604202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 368/726] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:38.605252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:38.613502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dff150-16d3-4c03-b9cc-d1d4274cd774 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:38.613819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dff150-16d3-4c03-b9cc-d1d4274cd774 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:38.614036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dff150-16d3-4c03-b9cc-d1d4274cd774 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:38.615745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 369/727] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:04:38.625879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b631-f6b3-4261-8cd2-012c67204d9a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:38.626192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b631-f6b3-4261-8cd2-012c67204d9a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:38.626470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c0b631-f6b3-4261-8cd2-012c67204d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:38.650863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-31c0b631-f6b3-4261-8cd2-012c67204d9a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:38.655736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-31c0b631-f6b3-4261-8cd2-012c67204d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:38.820356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 370/728] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:38 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:38.839323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810825a0-a65f-47cd-aa38-64c2133ca8e5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:38.853612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b631-f6b3-4261-8cd2-012c67204d9a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:38.913468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:38.914837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:38.915337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:38.915827 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:38.925754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:38.938478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:38.949454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:38.979043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:38.979989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:38.980876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:38.980876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:38.980876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:38.980876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:38.985170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 359/729] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:38.989013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.021414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:39.055618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c0b631-f6b3-4261-8cd2-012c67204d9a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.122029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a770ed-868f-46d6-9ad2-a9ae2c0115b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:39.123463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a770ed-868f-46d6-9ad2-a9ae2c0115b0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.123956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a770ed-868f-46d6-9ad2-a9ae2c0115b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.125196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a770ed-868f-46d6-9ad2-a9ae2c0115b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.138183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a770ed-868f-46d6-9ad2-a9ae2c0115b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-66a770ed-868f-46d6-9ad2-a9ae2c0115b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:39.148333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:39.149507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:39.150517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:39.153424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 371/730] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:39.155427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5392-f02f-4cab-b141-bef313e4baef None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.155849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5392-f02f-4cab-b141-bef313e4baef None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.156256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d5392-f02f-4cab-b141-bef313e4baef None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.161852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 372/731] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:39.162063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d5392-f02f-4cab-b141-bef313e4baef None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.168348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeb607-4f8e-4e9a-bdbe-6ef7c2dcfb39 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.207130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cae5d-d033-482a-a4e9-de00b5f612a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:39.207894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cae5d-d033-482a-a4e9-de00b5f612a9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.208132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cae5d-d033-482a-a4e9-de00b5f612a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.208419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cae5d-d033-482a-a4e9-de00b5f612a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.209509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cae5d-d033-482a-a4e9-de00b5f612a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:39.209824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cae5d-d033-482a-a4e9-de00b5f612a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:39.211326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cae5d-d033-482a-a4e9-de00b5f612a9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:39.229131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 360/732] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:39.229131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb06f32-a0a1-4ce3-b384-2773be8d009d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.229131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb06f32-a0a1-4ce3-b384-2773be8d009d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.229131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb06f32-a0a1-4ce3-b384-2773be8d009d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.246622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-feb06f32-a0a1-4ce3-b384-2773be8d009d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:39.248405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-feb06f32-a0a1-4ce3-b384-2773be8d009d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:39.295147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d5392-f02f-4cab-b141-bef313e4baef None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.310773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:39.326544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:39.340877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 361/733] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:39 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 06:04:39.341875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb06f32-a0a1-4ce3-b384-2773be8d009d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.345447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:39.347929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.347929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.347929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.347929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:39.347929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:39.349994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:39.367023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 373/734] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:39.369343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.483410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb06f32-a0a1-4ce3-b384-2773be8d009d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.500476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ef898-5c44-4f78-b288-40ba9703b02e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.520854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:39.521676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.522008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.522232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.529951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:39.531399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:39.540110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6039450-b427-4d95-b771-6f24e75e6965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:39.540779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039450-b427-4d95-b771-6f24e75e6965 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.541093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039450-b427-4d95-b771-6f24e75e6965 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.541377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6039450-b427-4d95-b771-6f24e75e6965 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.542101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6039450-b427-4d95-b771-6f24e75e6965 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:39.543467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6039450-b427-4d95-b771-6f24e75e6965 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:39.546790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:39.547693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:39.548642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 362/735] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:04:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:39.549251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.591656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:39.621007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 374/736] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:04:39 2022] POST /identity/v3/services => generated 251 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:39.621007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7c322-82ae-45cf-8710-332cb92682b1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.621007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7c322-82ae-45cf-8710-332cb92682b1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.621007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7c322-82ae-45cf-8710-332cb92682b1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.621007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 375/737] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:39.621007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7c322-82ae-45cf-8710-332cb92682b1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.679716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea9f6d-2fa2-4386-abb6-091fe15994cc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.691358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:39.742840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba3309-2488-4a9d-835e-89663ac7cdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:39.743574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3309-2488-4a9d-835e-89663ac7cdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.743857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3309-2488-4a9d-835e-89663ac7cdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.744134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba3309-2488-4a9d-835e-89663ac7cdb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.754580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7c322-82ae-45cf-8710-332cb92682b1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.757016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba3309-2488-4a9d-835e-89663ac7cdb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:39.758646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba3309-2488-4a9d-835e-89663ac7cdb9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e1ba3309-2488-4a9d-835e-89663ac7cdb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:39.781360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:39.782496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:39.783587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:39.783587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:39.783587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:39.783587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:39.786755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 363/738] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:39.787966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b6218-2227-44d8-ad12-131715add421 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.788435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b6218-2227-44d8-ad12-131715add421 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.788587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b6218-2227-44d8-ad12-131715add421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.800776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:39.801572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:39.801859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:39.802132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:39.802977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:39.803288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:39.804995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:39.808046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-738b6218-2227-44d8-ad12-131715add421 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:39.811091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-738b6218-2227-44d8-ad12-131715add421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:39.832581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 376/739] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:04:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:39.833740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.887763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 364/740] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:39.888776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b6218-2227-44d8-ad12-131715add421 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:39.913309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:39.960577 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83520af9-0fe7-426f-b176-d1dec7b54a02 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:39.970361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:40.007803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.008397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.008682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.009268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.010041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:40.010354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.011760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.025336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b6218-2227-44d8-ad12-131715add421 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.031749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 377/741] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:40.031749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.068550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.069799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.070288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.070785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.082653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.084435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:40.103309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:40.104261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:40.105220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:40.105220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:40.105220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:40.105220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:40.107540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 365/742] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:40.108733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.160798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8995b5a-56ac-42e3-8b6f-3cbf5fe95921 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.183696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:40.208708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.209974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.210460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.210931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.219439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26d468-7749-4c93-82d0-757edf9b037e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.224812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:40.233777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:40.234746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:40.235571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:40.238488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 378/743] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:40.239592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.271290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.272326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.272615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.272903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.274415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:40.284633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.286153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:40.308249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:40.309274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:40.311072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:40.312904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 366/744] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:40.313846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.367167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c593ad-a121-4aa2-b5a7-b5d9204433f2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.404643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.405609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.405897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.406179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.406910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:40.407233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.408607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.422376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 379/745] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:40.423227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.435799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c553be84-e316-44f0-8e16-e43251f6113e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.469723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:40.475932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d907ab-cfb6-44b0-bdc9-cc382df5bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.476721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d907ab-cfb6-44b0-bdc9-cc382df5bd8c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.477033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d907ab-cfb6-44b0-bdc9-cc382df5bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.477314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d907ab-cfb6-44b0-bdc9-cc382df5bd8c None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.478085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d907ab-cfb6-44b0-bdc9-cc382df5bd8c None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:40.478453 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d907ab-cfb6-44b0-bdc9-cc382df5bd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.479923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d907ab-cfb6-44b0-bdc9-cc382df5bd8c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.494581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 367/746] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:40.494581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346d0b-0977-4257-be47-4dac7a2a9800 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.494581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346d0b-0977-4257-be47-4dac7a2a9800 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.494581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac346d0b-0977-4257-be47-4dac7a2a9800 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.494581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 368/747] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:40.494999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346d0b-0977-4257-be47-4dac7a2a9800 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.530190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:40.546706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4941b3d-26b9-4b87-9a67-baee65801eac None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.583115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.583787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.584070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.584353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.585313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:40.585625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.587072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.609033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 380/748] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:40.610206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.622983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac346d0b-0977-4257-be47-4dac7a2a9800 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.656863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4774b2-48eb-4b83-abd5-ba065c1ef358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.657687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4774b2-48eb-4b83-abd5-ba065c1ef358 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.657972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4774b2-48eb-4b83-abd5-ba065c1ef358 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.658257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4774b2-48eb-4b83-abd5-ba065c1ef358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.665069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4774b2-48eb-4b83-abd5-ba065c1ef358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.666575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4774b2-48eb-4b83-abd5-ba065c1ef358 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2c4774b2-48eb-4b83-abd5-ba065c1ef358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:40.682152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:40.683271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:40.684141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 369/749] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:40.684834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c206-8717-427d-be33-6c51ce8430d9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.685186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c206-8717-427d-be33-6c51ce8430d9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.685468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241c206-8717-427d-be33-6c51ce8430d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.705241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7241c206-8717-427d-be33-6c51ce8430d9 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:40.706467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7241c206-8717-427d-be33-6c51ce8430d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:40.724129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85dc9f-22a2-4c7e-bd6e-53f96fe1347e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.781880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.782613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.782892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.783158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.794086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.796210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.797737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:40.800365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:40.816339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:40.817477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:40.818397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:40.818397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:40.818397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:40.818397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:40.818397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 381/750] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:40.818686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.821137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 370/751] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:40.822898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241c206-8717-427d-be33-6c51ce8430d9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:40.936408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241c206-8717-427d-be33-6c51ce8430d9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.936647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdbaba-425a-4f0f-b269-049f9043de00 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:40.972813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.973483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.973855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.974132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.974363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:40.975121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:40.975309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:40.975589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:40.976379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:40.976790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:40.978151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:40.991009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 371/752] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:40.991750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.042988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.044759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.052047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.053544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.102797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71959e35-0bd1-433f-b3df-b549b4249b2f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.141053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.141732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.142021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.142297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.143032 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:41.143344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.144721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.161971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 372/753] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:41.161971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.162219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 382/754] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:04:41.162219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.258730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.264936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f5e5c-6c4d-44e5-9af5-ed7752025b2e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.275006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e701bcb-27de-4243-98e5-0cd05bc35dcc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.277481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.307098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.308012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.308391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.308637 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/065014e1d5984a3db142381ccc62a420/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.311444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=065014e1d5984a3db142381ccc62a420, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.312971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.315974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.317229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.317493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.317768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] PATH_INFO: `/v3/services/network` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.318426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.319779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:41.332107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:41.333158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:41.339358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 373/755] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:41.340329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.375182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 383/756] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:41 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/065014e1d5984a3db142381ccc62a420/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:41.376230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.490291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855af506-0c15-4d5f-874c-3ae46416ca31 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.509506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507366b-f1d1-4267-9602-bfe878b5bb27 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.532917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.533980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.534364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.534860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.545464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.547788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.558991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.559796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.560111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.560388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:41.563814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:41.564734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:41.565749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 374/757] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:41.566346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.577280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.578778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.603695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:41.603890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:41.604756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:41.605803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:41.605803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:41.605803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:41.605803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:41.605803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 384/758] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:41.606111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.620096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.700054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c607bde-ec06-4d40-87f8-bc2781888155 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.729822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7e22e-019b-4c35-8632-9756fc521e5f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.744417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.745128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.745608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.745883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.746987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] RBAC: Adding query filter params (name=network) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:41.747919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.749772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.768498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.769320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.769676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.770024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.770941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:41.771324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.772836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.793346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 375/759] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:41.793346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.802189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 385/760] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:41.803182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.878453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.894521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:41.904500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839302-778a-4115-8f00-8f253cb9df56 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.916653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1ea44-19a6-4956-bc77-81c1283a8ad6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:41.941334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.942028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.942325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.942609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.943339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:41.943650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.945052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.954091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48261b45-d95d-4923-a168-80f63682893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:41.954760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48261b45-d95d-4923-a168-80f63682893e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.955066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48261b45-d95d-4923-a168-80f63682893e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.955317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48261b45-d95d-4923-a168-80f63682893e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.956026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48261b45-d95d-4923-a168-80f63682893e None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:41.956335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48261b45-d95d-4923-a168-80f63682893e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:41.957736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48261b45-d95d-4923-a168-80f63682893e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:41.962818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 376/761] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:41.962818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:41.973337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 386/762] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:41.974738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67459055-cfdc-43e1-8bf2-8154c9ccdb85 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:41.975029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67459055-cfdc-43e1-8bf2-8154c9ccdb85 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:41.975334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67459055-cfdc-43e1-8bf2-8154c9ccdb85 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:41.976716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 387/763] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:41.977368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67459055-cfdc-43e1-8bf2-8154c9ccdb85 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.070557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37378b3f-58ab-4d9f-bea5-4c13439cd0a8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.086627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67459055-cfdc-43e1-8bf2-8154c9ccdb85 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.110929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a29ce8-9b77-48aa-9497-e5d49823b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.111584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a29ce8-9b77-48aa-9497-e5d49823b584 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.111874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a29ce8-9b77-48aa-9497-e5d49823b584 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.112156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a29ce8-9b77-48aa-9497-e5d49823b584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.121239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:42.126548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.127349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.127669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.127911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.135189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:42.135449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.136864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:42.151328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:42.152288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 388/764] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:42.154490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.192657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a29ce8-9b77-48aa-9497-e5d49823b584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.194226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a29ce8-9b77-48aa-9497-e5d49823b584 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.275138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27804281-17e8-4eae-86a6-1ef87e76453c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.311778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 377/765] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:04:42.311778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb502bb-27aa-4b5f-ab3d-54c9753b7787 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.311778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb502bb-27aa-4b5f-ab3d-54c9753b7787 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.311778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb502bb-27aa-4b5f-ab3d-54c9753b7787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.314785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.315616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.316744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.317067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.317877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] RBAC: Adding query filter params (interface=public, service_id=205a32d2e08e4cb3b95498555d0c75d1, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:42.318195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.319576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.332864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 389/766] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/endpoints?service_id=205a32d2e08e4cb3b95498555d0c75d1&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:42.333081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bbb502bb-27aa-4b5f-ab3d-54c9753b7787 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:42.333208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.333297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bbb502bb-27aa-4b5f-ab3d-54c9753b7787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:42.385995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:42.397673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:42.409331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 378/767] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:42.417734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb502bb-27aa-4b5f-ab3d-54c9753b7787 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.446687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa385-bb66-4d31-ab8c-39928ada724d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.484004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.484782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.485113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.485396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.486188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:42.486496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.487943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.502293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 390/768] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:42.503197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.542057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb502bb-27aa-4b5f-ab3d-54c9753b7787 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.585279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.586418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.586893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.587381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.599914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.601792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:42.623521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:42.624479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:42.625518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:42.625518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:42.625518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:42.625518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:42.631789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 379/769] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:42.631789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.669589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:42.730167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fce11-8414-468b-99b2-aea33b3162a8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.744367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:42.749176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47601829-864a-4601-b5cb-05ba7c697798 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.764339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.764992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.765388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.765675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.766358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.770223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.773187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 391/770] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:42.774001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.801529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.803380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.803885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.804567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.805723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.808187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:42.830065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:42.831237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:42.832198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:42.839725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 380/771] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:42.839725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.919934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb46f5-118d-4fa6-97ac-8f4f989fabcd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:42.963926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:42.964594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:42.964877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:42.965257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:42.967118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=77c35cc610c74f66bc2625dd37dcefe7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:42.967118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:42.968398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:42.971414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:42.975777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 392/772] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/role_assignments?user.id=77c35cc610c74f66bc2625dd37dcefe7&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:42.976821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:42.980085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0268c9-e663-48b5-808d-43785b50cecc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:43.025300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:43.025995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.026283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.026640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.027375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:43.027741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:43.029528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:43.035474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:43.043398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 381/773] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:43.050661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:43.120124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae925e29-2c36-4e03-b215-5ccce451fafc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:43.171246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:43.172250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.172711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.173182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.174249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:43.174739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:43.176576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:43.183394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 393/774] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 18 06:04:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:43.190305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:43.254018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337e1acb-cafa-402f-8b2c-a99ad3be0d06 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:43.300736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:43.301988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.302427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.303194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.313529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941f0f8-f10a-4a2a-bff2-bd0a1ffd361e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:43.314384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:43.317407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:43.321607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:43.333954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:43.341110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:43.342008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 382/775] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:43.346001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:43.391172 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:43.391921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.392209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.392492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.393675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:43.393988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:43.395527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:43.399141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:43.411355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 394/776] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 18 06:04:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:43.418089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:43.555303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268a4ea-41d5-480f-8031-9a24bf1cee87 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:43.596738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:43.599210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.599367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.599650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.600466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:43.600781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:43.602338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:43.608631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3843bb-fa6f-46d6-b5f3-c000f3ef6a13 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:43.616922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 383/777] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:43.623726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:43.678342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c8a42-6ccb-44a8-865f-82bf23ca7737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:43.679034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c8a42-6ccb-44a8-865f-82bf23ca7737 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.679571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c8a42-6ccb-44a8-865f-82bf23ca7737 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.679848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c8a42-6ccb-44a8-865f-82bf23ca7737 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.680671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c8a42-6ccb-44a8-865f-82bf23ca7737 None admin] RBAC: Adding query filter params (interface=public, service_id=dd97fbe3771f47699d47e035734638c3, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:43.681006 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c8a42-6ccb-44a8-865f-82bf23ca7737 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:43.682765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c8a42-6ccb-44a8-865f-82bf23ca7737 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:43.690490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 395/778] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:04:43 2022] GET /identity/v3/endpoints?service_id=dd97fbe3771f47699d47e035734638c3&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:43.692013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158ee0-9158-4d4f-9f5a-6c81143a82fc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.692312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158ee0-9158-4d4f-9f5a-6c81143a82fc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.692697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e158ee0-9158-4d4f-9f5a-6c81143a82fc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.698617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 396/779] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:43.701823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b22a24-8a55-4385-80ba-00002df77c47 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.702148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b22a24-8a55-4385-80ba-00002df77c47 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.702399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b22a24-8a55-4385-80ba-00002df77c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.723422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a7b22a24-8a55-4385-80ba-00002df77c47 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:43.724638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a7b22a24-8a55-4385-80ba-00002df77c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:43.732867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:43.757377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:43.765174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71a14c-5595-4f91-a9b6-1773c74f69c9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:43.809541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:43.810975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:43.811347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:43.811699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:43.812268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 397/780] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:04:43.813192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b22a24-8a55-4385-80ba-00002df77c47 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:43.818046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=c4d472ed340f4bcdaaf9b30c43b0073c) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:43.818483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:43.820163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:43.834092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 384/781] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:43 2022] GET /identity/v3/role_assignments?user.id=c4d472ed340f4bcdaaf9b30c43b0073c&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:43.847106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:43.968690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b22a24-8a55-4385-80ba-00002df77c47 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:44.010687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:44.011363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:44.011752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:44.012032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:44.013370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:44.014842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:44.023879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 398/782] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:04:43 2022] GET /identity/v3/services => generated 772 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:44.038474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd87de-f0ef-4e24-a8ef-c039e9dbb8a3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:44.079269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:44.080017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:44.080306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:44.080589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:44.095789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:44.102087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:44.110921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:44.117625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:44.119550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 385/783] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:44.121196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:44.169697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:44.275520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97b3e3-8c5a-4ac7-8e4b-568b367484e1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:44.317113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:44.317810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:44.318097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:44.318375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:44.319149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:44.319460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:44.320889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:44.331351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 399/784] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:44.336958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:44.457384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb773cd5-053c-45c2-a8aa-fe96b8579c80 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:44.496402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:44.497954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:44.498248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:44.498528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:44.510477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:44.511941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:44.530971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:44.532090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:44.533580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:44.533580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:44.533580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:44.533580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:44.533580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 386/785] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:44.539602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:44.666640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:44.677033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fe296-d80e-4256-be56-126c059ea88b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:44.723533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:44.724211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:44.724500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:44.724781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:44.725545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:44.725857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:44.727236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:44.743691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 400/786] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:44.749853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:44.809104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:44.866457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece6c88-c14f-4b2a-932b-9477db192e5d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:44.908278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:44.909114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:44.909406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:44.909689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:44.918987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:44.921183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:44.936960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:44.938051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:44.940038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 387/787] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:04:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:44.943839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:45.064254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b633714c-d12f-4c29-aac0-af80ccb8792a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:45.104738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b1da3b-1bc5-4b37-bd08-4ba71b73f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:45.105487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1da3b-1bc5-4b37-bd08-4ba71b73f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.105775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1da3b-1bc5-4b37-bd08-4ba71b73f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.106052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1da3b-1bc5-4b37-bd08-4ba71b73f1f3 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.107284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1da3b-1bc5-4b37-bd08-4ba71b73f1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:45.107678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1da3b-1bc5-4b37-bd08-4ba71b73f1f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:45.109289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b1da3b-1bc5-4b37-bd08-4ba71b73f1f3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:45.139633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 401/788] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:04:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:45.145081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:45.256747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da654d-b49e-4aea-85e7-b9f2a84bb42a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:45.273061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:45.295512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:45.296190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.296480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.296762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.378665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:45.380182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:45.411710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba550-e0c6-4c38-bc00-bdc4b2652bce None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.412042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba550-e0c6-4c38-bc00-bdc4b2652bce None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.412324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba550-e0c6-4c38-bc00-bdc4b2652bce None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.413760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 402/789] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:04:45.419530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b4d0-79f4-40eb-b90a-1dbc055bce7e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.419823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b4d0-79f4-40eb-b90a-1dbc055bce7e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.420097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10b4d0-79f4-40eb-b90a-1dbc055bce7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.459887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6e10b4d0-79f4-40eb-b90a-1dbc055bce7e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:45.461131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6e10b4d0-79f4-40eb-b90a-1dbc055bce7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:45.473382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:45.495543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 388/790] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:04:45.501280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:45.521156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:45.573304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 403/791] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:45.575629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf113-2045-4180-b0ae-41e7423337e0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.576208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf113-2045-4180-b0ae-41e7423337e0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.576692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdf113-2045-4180-b0ae-41e7423337e0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.582536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 404/792] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:45.584327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6f7c8-817c-447a-92d1-2377ad8717b7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.584898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6f7c8-817c-447a-92d1-2377ad8717b7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.585548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf6f7c8-817c-447a-92d1-2377ad8717b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.603617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0bf6f7c8-817c-447a-92d1-2377ad8717b7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:45.605602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0bf6f7c8-817c-447a-92d1-2377ad8717b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:45.627634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1283e-6b54-4621-8cc9-b358e8e7be3a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:45.672602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:45.673437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.673722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.674145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.689556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:45.689556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:45.690101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 405/793] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:04:45.691272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6f7c8-817c-447a-92d1-2377ad8717b7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:45.710442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:45.711385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:45.712436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:45.712436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:45.712436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:45.712436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:45.712436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 389/794] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:45.717707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:45.784430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:45.802526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:45.827369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19297b48-fcb6-4e94-a528-3c44c5361bfb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:45.856221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf6f7c8-817c-447a-92d1-2377ad8717b7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:45.873948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:45.874621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.874903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.875177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.875904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:45.876209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:45.877632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:45.895520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 390/795] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:45.896433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:45.903912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:45.905083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:45.905365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:45.905635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] PATH_INFO: `/v3/services/network` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:45.906959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:45.908845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:45.926312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:45.927364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 06:04:45.928205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:45.930494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 406/796] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:45 2022] GET /identity/v3/services/network => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:45.930494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.014104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9760-1a51-420f-a813-289f0503cf48 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.040754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:46.052045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.052840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.060925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.060925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.065449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:46.073110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:46.074038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:46.074854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 391/797] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:46.076280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.082912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dedc5-728f-4c74-88a4-bb6dd873a1ae None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.119986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:46.126126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.126990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.135941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.135941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.135941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.136533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:46.151802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:46.152718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:46.153697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:46.157422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 407/798] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:46.158352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.204486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7494e610-63d4-4c03-a6fc-8b08d844fa13 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.244779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.245783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.246263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.247055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.249573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:46.250074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.252202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.259804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 392/799] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:46.261073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.294511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f9c159-f0c3-462e-a6a4-c9eaf480f38d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.334719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.335510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.335858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.336203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.337058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:46.337437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.338917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.339983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:46.348516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 408/800] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:46.349482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.406152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f1ec-7697-475c-824d-bc2b562804a7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.411358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:46.443976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.444807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.445475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.445772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.446839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:46.447153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.449085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.462980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649085d-5c0e-4ca0-bcf5-8217770ed4eb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.469727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 393/801] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:46.469727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.498524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adbd9d8-328d-44b4-b2ab-b4c909903209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.499207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd9d8-328d-44b4-b2ab-b4c909903209 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.499492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd9d8-328d-44b4-b2ab-b4c909903209 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.499767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adbd9d8-328d-44b4-b2ab-b4c909903209 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.500479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbd9d8-328d-44b4-b2ab-b4c909903209 None admin] RBAC: Adding query filter params (type=network) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:46.500790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbd9d8-328d-44b4-b2ab-b4c909903209 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.502236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adbd9d8-328d-44b4-b2ab-b4c909903209 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.507535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 409/802] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:46.508985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ff16f-cab0-4627-b574-99505185c9f3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.509309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ff16f-cab0-4627-b574-99505185c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.509587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ff16f-cab0-4627-b574-99505185c9f3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.511022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 410/803] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:46.514203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ff16f-cab0-4627-b574-99505185c9f3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.587950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb293c1-8c6f-4861-9b01-3d85027abddb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.600308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:46.627224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.628072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.628299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.628582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.636041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ff16f-cab0-4627-b574-99505185c9f3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.639160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.640606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.654227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:46.659738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:46.660685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:46.666608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:46.666608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:46.666608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:46.666608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:46.666608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 394/804] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:46.666608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.676888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d934f-da25-402d-83b7-9c577a783224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.677581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d934f-da25-402d-83b7-9c577a783224 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.677864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d934f-da25-402d-83b7-9c577a783224 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.678130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d934f-da25-402d-83b7-9c577a783224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.678967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d934f-da25-402d-83b7-9c577a783224 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=065014e1d5984a3db142381ccc62a420) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:46.679525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d934f-da25-402d-83b7-9c577a783224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.681037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d934f-da25-402d-83b7-9c577a783224 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.687634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 411/805] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/role_assignments?user.id=065014e1d5984a3db142381ccc62a420&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:46.688908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3a06-0641-45d4-b782-1121e86ac110 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.692016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3a06-0641-45d4-b782-1121e86ac110 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.692016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c3a06-0641-45d4-b782-1121e86ac110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.714849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-100c3a06-0641-45d4-b782-1121e86ac110 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:46.717970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-100c3a06-0641-45d4-b782-1121e86ac110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:46.812243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7fe53d-b34f-4695-81c1-97159cfeea7a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.812932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 412/806] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:46.813664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c3a06-0641-45d4-b782-1121e86ac110 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.852841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c163ff-8dbb-46d1-8b2d-c52e27e8aaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.854074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c163ff-8dbb-46d1-8b2d-c52e27e8aaa2 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.854314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c163ff-8dbb-46d1-8b2d-c52e27e8aaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.854596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c163ff-8dbb-46d1-8b2d-c52e27e8aaa2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.855621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c163ff-8dbb-46d1-8b2d-c52e27e8aaa2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.857398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c163ff-8dbb-46d1-8b2d-c52e27e8aaa2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.926752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c3a06-0641-45d4-b782-1121e86ac110 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:46.941114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:46.962092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e72b4b-27a5-410a-a2e0-3d97de874409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:46.962756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e72b4b-27a5-410a-a2e0-3d97de874409 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.963044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e72b4b-27a5-410a-a2e0-3d97de874409 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.963322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e72b4b-27a5-410a-a2e0-3d97de874409 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.964080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e72b4b-27a5-410a-a2e0-3d97de874409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:46.964391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e72b4b-27a5-410a-a2e0-3d97de874409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:46.965894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e72b4b-27a5-410a-a2e0-3d97de874409 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:46.978525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 413/807] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:46.985043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9f85-2b78-4ee1-84ef-ab14f2c8a8cb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.985043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9f85-2b78-4ee1-84ef-ab14f2c8a8cb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.985043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9f85-2b78-4ee1-84ef-ab14f2c8a8cb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:46.985043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 414/808] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:46.985043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9f85-2b78-4ee1-84ef-ab14f2c8a8cb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:46.986135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 395/809] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:04:46 2022] POST /identity/v3/endpoints => generated 327 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:46.994762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9208-ec86-4d16-8e70-cf3cf773e58f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:46.995477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9208-ec86-4d16-8e70-cf3cf773e58f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:46.995689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbf9208-ec86-4d16-8e70-cf3cf773e58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.041072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9bbf9208-ec86-4d16-8e70-cf3cf773e58f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:47.043173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9bbf9208-ec86-4d16-8e70-cf3cf773e58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:47.061677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:47.127669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9f85-2b78-4ee1-84ef-ab14f2c8a8cb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.164687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 396/810] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:47.164687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf9208-ec86-4d16-8e70-cf3cf773e58f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.193098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.194882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.195685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.196201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.217985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:47.225941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:47.226911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:47.227736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 415/811] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:47.228431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.263444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:47.288801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbf9208-ec86-4d16-8e70-cf3cf773e58f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.326716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.327531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.327817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.328102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.335696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.337208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.352834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1bb40-24b8-46c6-a783-fc5fee125e11 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:47.353257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:47.354242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:47.355177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 397/812] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:47.355754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.367310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:47.399700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.400516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.400803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.401110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.401771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.403643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:47.416375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:47.417560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:47.418401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 416/813] 10.222.0.27 () {56 vars in 1129 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:47.419258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.482707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f5106-43bb-4ca0-8396-567c6be1d215 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.520513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:47.522530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.523310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.523601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.523951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.524849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:47.524958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.526349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.532175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7048b-5ab9-46fd-89a6-edb7eb1ca62f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.535504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 398/814] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:47.536514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.572165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.572836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.573174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.573452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.574295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:47.574631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.576875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.596448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 417/815] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:47.597294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.620658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:47.660712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625fad4b-e26e-43cd-8d62-28a5bb903bd8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.699263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.700063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.700569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.700883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.702166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:47.702477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.703857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.704796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d60de-065e-4a39-a268-23fe51552123 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.714359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 399/816] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:47.714359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.744937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.745917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.746522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.746808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.758678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.760257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:47.778724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:47.779915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:47.780795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:47.780795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:47.780795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:47.780795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:47.780795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 418/817] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:47.780795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.783441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:47.824908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee737-a008-4c74-a1d8-fe35a9249831 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.854691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:47.861794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.862953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.863237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.863512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.876299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.877867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.889456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011392a7-530e-48f6-b68f-ab4babea71ec None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:47.905986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:47.906917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:47.907794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:47.907794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:47.907794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:47.907794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:47.912019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 400/818] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:47.912645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:47.929856 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:47.930926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:47.931367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:47.931658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:47.932373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:47.932796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:47.934101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:47.940095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 419/819] 10.222.0.27 () {56 vars in 1124 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:47.940994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.009737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:48.026910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d9c5a-ed34-44e2-bdf9-719458745f61 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.047175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece1084-a672-462c-98a5-e774ab53aa7b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.062527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.063197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.063491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.063761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.064483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:48.064795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.066192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.082659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 401/820] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:48.082659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.088849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.089548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.089833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.090114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.091391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:48.091714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.093119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.113067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 420/821] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:48.113067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.128628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:48.197203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd931074-d0cb-4d66-a70b-9ad88fc8ffd8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.240517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.241238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.241528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.241809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.241940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4479789-37cf-4b7b-a1bf-04b4b2c3248d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.242588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.244007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.272104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:48.281337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.282168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.282446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.282722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.290748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.292234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:48.308771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:48.310454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 421/822] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:04:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:48.316424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.348634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 402/823] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:04:48 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:48.348634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.445224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f007d3-30b5-41a3-be1f-814eff2216b1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.488657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:48.490107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e0d01-795b-4028-9e91-1faae95955f6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.499654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.503507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.503507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.503507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.511512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.514182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:48.531271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:48.535778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:48.536700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 422/824] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:48.541015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.541789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.542075 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.542350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.542739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.543204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:48.543514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.546367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.571544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 403/825] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 18 06:04:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:48.577368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.607202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:48.678084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55605b-2ca6-4116-8983-38bf56f99c76 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.693389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3890bc-6d5c-46b0-9de5-9564e2a23ff3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.719357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.720744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.721285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.721957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.723078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:48.723613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.725575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.730321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.731133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.731421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.732431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.744149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.745584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.746548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 423/826] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:48.748538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:48.766657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:48.767617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:48.768881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:48.768881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:48.768881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:48.768881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:48.768881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 404/827] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:48.774800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:48.793679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:48.873113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99bd8a-05fb-4a7c-ab83-322bb1ce0ad5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.882189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:48.917801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1024a8-c452-4855-bbcc-57ed74ef0ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.919324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1024a8-c452-4855-bbcc-57ed74ef0ff4 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.919787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1024a8-c452-4855-bbcc-57ed74ef0ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.920266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1024a8-c452-4855-bbcc-57ed74ef0ff4 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/77c35cc610c74f66bc2625dd37dcefe7/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.924179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1024a8-c452-4855-bbcc-57ed74ef0ff4 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=77c35cc610c74f66bc2625dd37dcefe7, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.926050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1024a8-c452-4855-bbcc-57ed74ef0ff4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:48.936395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60166f3-519e-4d00-a251-bdd38d591e0d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:48.971492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:48.974083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:48.974083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:48.974083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:48.974083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:48.974083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:48.975957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:49.052875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 424/828] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:48 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/77c35cc610c74f66bc2625dd37dcefe7/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:49.052875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd255-ef25-4a70-895a-5f39bf217b3b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.052875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd255-ef25-4a70-895a-5f39bf217b3b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.052875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3bd255-ef25-4a70-895a-5f39bf217b3b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.052875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 425/829] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:49.054897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60569-5026-4b8f-9d61-6fea8531ac09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.055974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60569-5026-4b8f-9d61-6fea8531ac09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.055974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60569-5026-4b8f-9d61-6fea8531ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.076882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-82d60569-5026-4b8f-9d61-6fea8531ac09 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:49.078398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-82d60569-5026-4b8f-9d61-6fea8531ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:49.108912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 405/830] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:49.115217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:49.176948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 426/831] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:49.204890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60569-5026-4b8f-9d61-6fea8531ac09 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:49.220404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:49.284869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af138834-6253-4a15-b467-5842af870ab3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:49.330437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:49.332129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.332573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.333072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.342997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:49.345522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:49.353161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60569-5026-4b8f-9d61-6fea8531ac09 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:49.354953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:49.365740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:49.366859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:49.368044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:49.370532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 406/832] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:49.376898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:49.399400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:49.400300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.400590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.400864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.401584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:49.403074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:49.420546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:49.421605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:49.422455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:49.426985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 427/833] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 18 06:04:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:49.429500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:49.495842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7f63-ea3e-482a-8254-c852760e7c46 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:49.524925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:49.534943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:49.535862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.536316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.536807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.539106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:49.539106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:49.540136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:49.546544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7487-e1c7-4f9f-a829-e721e851eaed None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:49.559527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 407/834] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:49.561612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:49.586313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:49.586985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.587273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.587566 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.588338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:49.588649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:49.590178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:49.601143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 428/835] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:04:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:49.602914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:49.637372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:49.676322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e80e219-5661-46e2-bcc2-15420c0cdb94 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:49.728440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc07e44-c981-46f0-b7e1-37ae9827ced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:49.729361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07e44-c981-46f0-b7e1-37ae9827ced8 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.729649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07e44-c981-46f0-b7e1-37ae9827ced8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.729929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc07e44-c981-46f0-b7e1-37ae9827ced8 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/c4d472ed340f4bcdaaf9b30c43b0073c/roles/9ff6030cc666452ea3f178662d71993d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.745280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475515c-512c-4dbb-9bcd-2f87714a92ab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:49.747748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc07e44-c981-46f0-b7e1-37ae9827ced8 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=c4d472ed340f4bcdaaf9b30c43b0073c, role_id=9ff6030cc666452ea3f178662d71993d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:49.749885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc07e44-c981-46f0-b7e1-37ae9827ced8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:49.795256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4629240-cb24-4087-aa0b-76bc1099a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:49.796273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4629240-cb24-4087-aa0b-76bc1099a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:49.796732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4629240-cb24-4087-aa0b-76bc1099a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:49.797220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4629240-cb24-4087-aa0b-76bc1099a4e0 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:49.798082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4629240-cb24-4087-aa0b-76bc1099a4e0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:49.798537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4629240-cb24-4087-aa0b-76bc1099a4e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:49.800061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4629240-cb24-4087-aa0b-76bc1099a4e0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:49.811879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 429/836] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:04:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:49.823867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 408/837] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:04:49 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/c4d472ed340f4bcdaaf9b30c43b0073c/roles/9ff6030cc666452ea3f178662d71993d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:04:50.585611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf6339-9fd2-4750-98d4-177285343b81 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:50.585849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf6339-9fd2-4750-98d4-177285343b81 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:50.586262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf6339-9fd2-4750-98d4-177285343b81 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:50.587762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 430/838] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:50.594192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08aa9-7e53-4717-908a-e891f9fa10e3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:50.594684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08aa9-7e53-4717-908a-e891f9fa10e3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:50.594760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08aa9-7e53-4717-908a-e891f9fa10e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:50.613010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e1a08aa9-7e53-4717-908a-e891f9fa10e3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:50.614243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1a08aa9-7e53-4717-908a-e891f9fa10e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:50.645490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:50.689128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 409/839] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:04:50.715036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf6339-9fd2-4750-98d4-177285343b81 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:50.816098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:50.829606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf6339-9fd2-4750-98d4-177285343b81 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:50.867242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:50.867973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:50.868260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:50.868539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:50.869240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:50.870682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:50.885904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:50.886978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:50.888864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 431/840] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:50.893627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08aa9-7e53-4717-908a-e891f9fa10e3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:51.014190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08aa9-7e53-4717-908a-e891f9fa10e3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:51.053907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69173c-e5d8-459c-9abd-a57b2c308adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:51.054845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69173c-e5d8-459c-9abd-a57b2c308adb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:51.055132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69173c-e5d8-459c-9abd-a57b2c308adb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:51.055411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69173c-e5d8-459c-9abd-a57b2c308adb None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:51.056133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69173c-e5d8-459c-9abd-a57b2c308adb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:51.056443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69173c-e5d8-459c-9abd-a57b2c308adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:51.057864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69173c-e5d8-459c-9abd-a57b2c308adb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:51.064153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 410/841] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:51.070165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:51.188030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6023c-5328-40a7-bcfc-5d7e16c70dcc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:51.226384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19efd0bc-978e-4c6f-9db0-a5213c11380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:51.227140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd0bc-978e-4c6f-9db0-a5213c11380e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:51.227514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd0bc-978e-4c6f-9db0-a5213c11380e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:51.227730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19efd0bc-978e-4c6f-9db0-a5213c11380e None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:51.228450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efd0bc-978e-4c6f-9db0-a5213c11380e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:51.228760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efd0bc-978e-4c6f-9db0-a5213c11380e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:51.230172 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19efd0bc-978e-4c6f-9db0-a5213c11380e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:51.234667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082ea7-70ea-46f6-bc15-af015385c8b4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:51.234958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082ea7-70ea-46f6-bc15-af015385c8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:51.235235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082ea7-70ea-46f6-bc15-af015385c8b4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:51.236062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 432/842] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:51.236590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 411/843] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:51.242687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a1794-7d75-44c3-bb81-befd4b9c6ede None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:51.242968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a1794-7d75-44c3-bb81-befd4b9c6ede None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:51.243253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249a1794-7d75-44c3-bb81-befd4b9c6ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:51.263590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-249a1794-7d75-44c3-bb81-befd4b9c6ede None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:51.264845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-249a1794-7d75-44c3-bb81-befd4b9c6ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:51.277399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:51.351928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 433/844] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:51 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:51.375865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082ea7-70ea-46f6-bc15-af015385c8b4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:51.412716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:51.495233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082ea7-70ea-46f6-bc15-af015385c8b4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:51.532770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:51.533632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:51.533912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:51.534211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:51.547001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:51.555125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:51.556091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:51.557381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 412/845] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:51.563606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a1794-7d75-44c3-bb81-befd4b9c6ede None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:51.680609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249a1794-7d75-44c3-bb81-befd4b9c6ede None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:51.721501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:51.722407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:51.722716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:51.723003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:51.723831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:51.724307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:51.725946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:51.737644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 434/846] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:51.743103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:51.842921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:51.853229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac055d2a-012d-4c03-856b-2edc06483976 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:51.889726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec697871-c054-4df9-9eba-5e4c1b19061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:51.890794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697871-c054-4df9-9eba-5e4c1b19061f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:51.891229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697871-c054-4df9-9eba-5e4c1b19061f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:51.891655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec697871-c054-4df9-9eba-5e4c1b19061f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:51.907170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec697871-c054-4df9-9eba-5e4c1b19061f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:51.908644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec697871-c054-4df9-9eba-5e4c1b19061f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ec697871-c054-4df9-9eba-5e4c1b19061f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:51.926987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:51.928010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:51.928957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:51.928957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:51.928957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:51.928957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:51.928957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 413/847] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:51.935879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:51.953357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:52.043631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b8674-24f8-427b-a385-26701c351bdd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:52.058533 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88227ff4-5c0d-430e-a6b9-afc21d1c9554 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.058865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88227ff4-5c0d-430e-a6b9-afc21d1c9554 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.059175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88227ff4-5c0d-430e-a6b9-afc21d1c9554 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.061184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 414/848] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:52.070476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129b34-e53e-45ff-9ceb-fb0e7a48d168 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.070773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129b34-e53e-45ff-9ceb-fb0e7a48d168 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.071060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129b34-e53e-45ff-9ceb-fb0e7a48d168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.087360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df1f0f-ffdb-4b3d-9de1-b8ab21e0d7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:52.088064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df1f0f-ffdb-4b3d-9de1-b8ab21e0d7d8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.088351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df1f0f-ffdb-4b3d-9de1-b8ab21e0d7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.088629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df1f0f-ffdb-4b3d-9de1-b8ab21e0d7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.089439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df1f0f-ffdb-4b3d-9de1-b8ab21e0d7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:52.089754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df1f0f-ffdb-4b3d-9de1-b8ab21e0d7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:52.091330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df1f0f-ffdb-4b3d-9de1-b8ab21e0d7d8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:52.093906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5f129b34-e53e-45ff-9ceb-fb0e7a48d168 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:52.095699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5f129b34-e53e-45ff-9ceb-fb0e7a48d168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:52.104692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 435/849] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:52.105938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e2ad4-d9f2-4496-aa75-83d10c69c662 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.106235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e2ad4-d9f2-4496-aa75-83d10c69c662 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.106647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e2ad4-d9f2-4496-aa75-83d10c69c662 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.108647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 436/850] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:52.111469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e2ad4-d9f2-4496-aa75-83d10c69c662 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:52.178124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 415/851] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:52.180026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658289-44f6-4211-8e6a-e5ebafecbd6a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.180309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658289-44f6-4211-8e6a-e5ebafecbd6a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.180582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14658289-44f6-4211-8e6a-e5ebafecbd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.204420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-14658289-44f6-4211-8e6a-e5ebafecbd6a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:52.205025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:52.206203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-14658289-44f6-4211-8e6a-e5ebafecbd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:52.241234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e2ad4-d9f2-4496-aa75-83d10c69c662 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:52.277891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:52.279081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.279362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.279640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] PATH_INFO: `/v3/users/swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.297017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 416/852] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:52.297250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:52.297353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14658289-44f6-4211-8e6a-e5ebafecbd6a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:52.297444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:52.298431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:52.316352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:52.317583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:52.318699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 437/853] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:04:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:52.325384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:52.416681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14658289-44f6-4211-8e6a-e5ebafecbd6a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:52.437830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e2e35-86c9-4ed2-bcfa-2eb2cc1c83ad None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:52.460634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:52.461266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.461543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.461834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.469966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:52.475129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:52.479688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:52.495576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.495576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.495576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.495576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:52.496069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:52.497237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:04:52.498268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:52.498947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:52.499031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 417/854] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:04:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:52.499031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:52.552746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:52.593626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72774abe-a9e9-4a1e-9810-13fb38bc4ba3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:52.604910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 438/855] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:04:52 2022] POST /identity/v3/services => generated 269 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:52.604910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:52.649029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:52.649832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.650172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.650455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.651316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:52.651639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:52.653490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:52.678044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 418/856] 10.222.0.27 () {56 vars in 1135 bytes} [Mon Jul 18 06:04:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:52.683839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:52.794717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908666-f530-41ce-a50e-9a8f95826673 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:52.805792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edde42f-1d71-48ed-b166-c063a659eb20 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:52.839929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:52.840531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.840838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.841140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.841899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:52.842321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:52.843959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:52.844427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:52.855999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 439/857] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:04:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:52.866204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:52.876686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:52.878057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:52.878582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:52.879393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:52.934456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:52.965037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:52.967126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:52.997983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88708e24-e208-4109-a24a-d17f35192062 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.042085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.042893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.043179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.043458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.056209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.057924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.074449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 419/858] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:52 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:53.078315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:53.079224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:53.080177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:53.080177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:53.080177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:53.080177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:53.080406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.084398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 440/859] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:53.085677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.102487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:53.196597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac2ed0-9ca4-44f1-95bc-6503357ade25 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.215659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ae084-bdc4-4899-9220-479650a45846 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.217967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:53.234675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.235482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.235794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.236101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.250019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.251497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.266417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.267082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.267357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.267632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.268376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:53.268670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.270084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:53.281414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:53.282374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:53.283278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:53.283278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:53.283278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:53.283278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:53.283927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 441/860] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:53.285773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 420/861] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:53.291145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.293244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.389526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:53.420702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d7a5c4-9033-4996-8ab3-657932e5f9b4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.452821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29939c6a-cad7-4fbf-81d5-0c82bf9f4399 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.460292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243f5c6-3451-4679-b9f8-70795c018d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.461293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f5c6-3451-4679-b9f8-70795c018d23 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.461599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f5c6-3451-4679-b9f8-70795c018d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.461877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243f5c6-3451-4679-b9f8-70795c018d23 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.470997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f5c6-3451-4679-b9f8-70795c018d23 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.472491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243f5c6-3451-4679-b9f8-70795c018d23 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1243f5c6-3451-4679-b9f8-70795c018d23 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:53.489100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:53.490137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:53.491072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:53.495541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 442/862] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:53.496951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8cdfd-9892-480c-88b5-6b43259b557f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.497993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8cdfd-9892-480c-88b5-6b43259b557f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.498379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8cdfd-9892-480c-88b5-6b43259b557f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.501657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 443/863] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:53.501657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8cdfd-9892-480c-88b5-6b43259b557f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.515235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59626d6d-5be7-4ce2-8da7-e8563f555ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.515930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626d6d-5be7-4ce2-8da7-e8563f555ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.516214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626d6d-5be7-4ce2-8da7-e8563f555ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.516719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59626d6d-5be7-4ce2-8da7-e8563f555ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.517507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59626d6d-5be7-4ce2-8da7-e8563f555ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:53.517820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59626d6d-5be7-4ce2-8da7-e8563f555ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.519241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59626d6d-5be7-4ce2-8da7-e8563f555ff6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.533035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 421/864] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:53.534690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da1416-f299-4b78-99a5-50bc42ca466d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.534972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da1416-f299-4b78-99a5-50bc42ca466d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.535262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da1416-f299-4b78-99a5-50bc42ca466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.548074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:53.553909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-96da1416-f299-4b78-99a5-50bc42ca466d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:53.570189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-96da1416-f299-4b78-99a5-50bc42ca466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:53.629701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 422/865] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:53 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:53.630852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da1416-f299-4b78-99a5-50bc42ca466d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.642804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8cdfd-9892-480c-88b5-6b43259b557f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.681137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.682109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.682984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.683473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.685803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:53.686368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.688741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.704821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:53.710104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 444/866] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:53.710931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.758056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da1416-f299-4b78-99a5-50bc42ca466d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.798870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.799750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.800061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.800339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.801344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:53.807918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.809410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.822093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d837cf-073c-4fa6-951f-52450fd77fd4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:53.824920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:53.826334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:53.827499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:53.830939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 423/867] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:53.831869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.864060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.864742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.865049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.865336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:53.866183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:53.867541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:53.941812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489aa5d-09ac-42ce-b124-297bd54226f1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:53.959402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:53.969046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 445/868] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:04:53 2022] POST /identity/v3/services => generated 251 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:53.969046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:53.995836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:53.998401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:53.999133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:53.999781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.110119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96534e14-db6a-4438-a6cf-8f6c0985a15c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:54.117419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:54.119931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:54.157422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:54.158252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.158544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.158888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.159676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:54.159991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:54.162863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:54.172301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:54.176538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 446/869] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:54.184192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:54.262504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 424/870] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:04:54.267404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:54.283576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:54.299050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa04cb9-1a12-46c2-9031-86c196975019 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:54.340406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:54.341604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.342126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.342824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.343953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=77c35cc610c74f66bc2625dd37dcefe7) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:54.344495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:54.346242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:54.353718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 447/871] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:54 2022] GET /identity/v3/role_assignments?user.id=77c35cc610c74f66bc2625dd37dcefe7&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:54.383018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb61c69-4691-4398-b5e0-1703d1949e1c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:54.423820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:54.424654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.424940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.425246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.438474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:54.440122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:54.460394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:54.461378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:54.462429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:54.462429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:54.462429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:54.462429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:54.462429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 425/872] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:54.468114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:54.544507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:54.588372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f442e-ec6c-4238-9bde-837917455d0f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:54.627798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45846b96-83d4-41ad-abb6-6bd64a6e7656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:54.628475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846b96-83d4-41ad-abb6-6bd64a6e7656 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.628805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846b96-83d4-41ad-abb6-6bd64a6e7656 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.629136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45846b96-83d4-41ad-abb6-6bd64a6e7656 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.629876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45846b96-83d4-41ad-abb6-6bd64a6e7656 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:54.630189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45846b96-83d4-41ad-abb6-6bd64a6e7656 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:54.631572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45846b96-83d4-41ad-abb6-6bd64a6e7656 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:54.646686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 448/873] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:54.652103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:54.726125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:54.762568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222b424-c9c3-45e8-ad3a-6f31e9ecccb9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:54.801523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:54.802254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.802541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.802821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.810898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:54.812359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:54.826932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:54.827869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:54.828862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 426/874] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:54.833932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29b0b2-595c-4a66-af1d-4e2385aef86d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.834221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29b0b2-595c-4a66-af1d-4e2385aef86d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.834327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:54.834494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b29b0b2-595c-4a66-af1d-4e2385aef86d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.836103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 449/875] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:54.841761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62349105-e7a8-4712-b19c-d1f1c6cda663 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.842057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62349105-e7a8-4712-b19c-d1f1c6cda663 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.842326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62349105-e7a8-4712-b19c-d1f1c6cda663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.859534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-62349105-e7a8-4712-b19c-d1f1c6cda663 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:54.860720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-62349105-e7a8-4712-b19c-d1f1c6cda663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:54.936430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 450/876] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:04:54.945976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af8a5b-d046-4098-90ae-9ca384314a59 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:54.959151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62349105-e7a8-4712-b19c-d1f1c6cda663 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:54.974424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:54.984369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:54.995789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:54.995789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:54.995789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:54.995789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:54.995789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:54.995789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:55.002422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 427/877] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:55.008634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:55.035011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:55.098832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62349105-e7a8-4712-b19c-d1f1c6cda663 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:55.128177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ec7997-bd0d-4109-a382-66179c59d2c8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:55.147861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:55.149700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:55.150585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:55.151039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:55.151878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:55.154623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:55.172655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:55.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:55.174592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 451/878] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 18 06:04:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:55.182178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:55.185500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:55.187347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:55.187863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:55.188360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:55.189468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=c4d472ed340f4bcdaaf9b30c43b0073c) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:55.189988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:55.191667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:55.201345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 428/879] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:04:55 2022] GET /identity/v3/role_assignments?user.id=c4d472ed340f4bcdaaf9b30c43b0073c&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:55.316846 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83aaab7-f326-45fc-b71c-c613163a215e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:55.353440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:55.359243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:55.360256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:55.360707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:55.370249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:55.370249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:55.370249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:55.370249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:55.371407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 452/880] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:04:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:55.377611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:55.436051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:55.491288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792dec5-2cb1-40e8-bed1-f1fc2f799ddb None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:55.530830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:55.531808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:55.532302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:55.532775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:55.533684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:55.534156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:55.535815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:55.542094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 429/881] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:04:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:55.548116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:55.662948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd0d1-28b4-48c9-9df7-22edd14f26be None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:55.705207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7150b6f0-819c-40a3-b5aa-81826fafc4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:55.706665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150b6f0-819c-40a3-b5aa-81826fafc4fc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:55.707389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150b6f0-819c-40a3-b5aa-81826fafc4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:55.708109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7150b6f0-819c-40a3-b5aa-81826fafc4fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:55.709776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150b6f0-819c-40a3-b5aa-81826fafc4fc None admin] RBAC: Adding query filter params (interface=public, service_id=729a1ec55afc4f218f4b240e2a22384a, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:55.710571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150b6f0-819c-40a3-b5aa-81826fafc4fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:55.713196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7150b6f0-819c-40a3-b5aa-81826fafc4fc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:55.720209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 453/882] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:04:55 2022] GET /identity/v3/endpoints?service_id=729a1ec55afc4f218f4b240e2a22384a&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:55.726150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:55.843985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae975498-42b5-4218-ba31-83c10948f920 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:55.869756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:55.883751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653ef7e-28cc-4146-ade2-1bf2899c5e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:55.884736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653ef7e-28cc-4146-ade2-1bf2899c5e23 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:55.885314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653ef7e-28cc-4146-ade2-1bf2899c5e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:55.885780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653ef7e-28cc-4146-ade2-1bf2899c5e23 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:55.886653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653ef7e-28cc-4146-ade2-1bf2899c5e23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:55.888822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653ef7e-28cc-4146-ade2-1bf2899c5e23 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:55.895838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 430/883] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:04:55 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:04:56.463680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74632-ffeb-427d-8355-bd46dea978eb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:56.464210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74632-ffeb-427d-8355-bd46dea978eb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:56.464287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f74632-ffeb-427d-8355-bd46dea978eb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:56.467074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 454/884] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:56.473150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbf6f-da74-4088-8a12-33c3a5d48ae3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:56.473494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbf6f-da74-4088-8a12-33c3a5d48ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:56.473734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dcbf6f-da74-4088-8a12-33c3a5d48ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:56.493401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-02dcbf6f-da74-4088-8a12-33c3a5d48ae3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:56.494656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-02dcbf6f-da74-4088-8a12-33c3a5d48ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:56.581661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 431/885] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:56.600671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d9c46-282d-49c1-93fc-be949914a1c4 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:56.600962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d9c46-282d-49c1-93fc-be949914a1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:56.601279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6d9c46-282d-49c1-93fc-be949914a1c4 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:56.603061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 455/886] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:56.604850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcbf6f-da74-4088-8a12-33c3a5d48ae3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:56.609277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e2a6-f220-48a5-9fdd-1a07540ad2ab None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:56.609575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e2a6-f220-48a5-9fdd-1a07540ad2ab None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:56.609858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b2e2a6-f220-48a5-9fdd-1a07540ad2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:56.628050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-44b2e2a6-f220-48a5-9fdd-1a07540ad2ab None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:56.629869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-44b2e2a6-f220-48a5-9fdd-1a07540ad2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:56.688615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:56.727636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 456/887] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:04:56.729073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dcbf6f-da74-4088-8a12-33c3a5d48ae3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:56.742614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:56.753175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e2a6-f220-48a5-9fdd-1a07540ad2ab None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:56.772895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:56.773878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:56.774169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:56.774483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:56.775619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:56.777151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:56.792807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:56.794283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:56.795744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 432/888] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:56.805246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:56.865806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b2e2a6-f220-48a5-9fdd-1a07540ad2ab None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:56.907791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:56.908998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:56.909447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:56.909886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:56.910814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:56.912221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:56.926021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:56.927078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:04:56.927912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:56.932707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 457/889] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:04:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:56.933502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:56.950591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f298994-536b-411a-b2a8-769b787feaec None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:56.983941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:56.990242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:56.990632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:56.990918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:56.991200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:56.991963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:56.992454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:56.994071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:57.001685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 433/890] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:57.007542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:57.047905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:57.055564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819280e3-387c-412f-8a23-d8bbcbf790ae None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:57.097623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:57.098701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.099263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.099766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.100706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:57.101282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:57.102936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:57.108880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 458/891] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:04:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:57.121155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:57.128634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373310e-3057-498b-ae82-0f248d37b324 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:57.167361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:57.167921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.168210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.168490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.169924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:57.170240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:57.171657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:57.181342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 434/892] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:04:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:57.184294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:57.242270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e940c7-e7db-4e04-88a1-2c4ec6663615 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:57.245122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:57.284254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:57.285524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.286016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.286441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.287325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:57.287779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:57.289570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:57.301500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 459/893] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:04:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:57.308913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:57.313168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0540886-6e59-4bbc-ab69-2581a41980dc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:57.359262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fd6ec-516e-4017-b210-576060412ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:57.360291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fd6ec-516e-4017-b210-576060412ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.360726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fd6ec-516e-4017-b210-576060412ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.361198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fd6ec-516e-4017-b210-576060412ff2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.362200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fd6ec-516e-4017-b210-576060412ff2 None admin] RBAC: Adding query filter params (interface=public, service_id=5c18dedcd4954b4c877033bd905df6e9, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:57.362691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fd6ec-516e-4017-b210-576060412ff2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:57.364268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fd6ec-516e-4017-b210-576060412ff2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:57.374244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 435/894] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:04:57 2022] GET /identity/v3/endpoints?service_id=5c18dedcd4954b4c877033bd905df6e9&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:04:57.382192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:57.501994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56037f3-6fa6-4669-83e2-a65f39e3f88f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:57.539821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70700efd-199c-448c-9191-199b8bf3f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:57.540734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700efd-199c-448c-9191-199b8bf3f7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.541187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700efd-199c-448c-9191-199b8bf3f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.541633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70700efd-199c-448c-9191-199b8bf3f7a9 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.542467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700efd-199c-448c-9191-199b8bf3f7a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:57.544021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70700efd-199c-448c-9191-199b8bf3f7a9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:57.550785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 460/895] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:04:57 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:04:57.564421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f86d1-2fa8-4a9c-ba83-2136e63b8e2a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.564715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f86d1-2fa8-4a9c-ba83-2136e63b8e2a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.565030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f86d1-2fa8-4a9c-ba83-2136e63b8e2a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.566830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 436/896] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:57.572647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df7b8-e320-4fda-a41a-b5e4b9443d34 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.572938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df7b8-e320-4fda-a41a-b5e4b9443d34 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.573256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277df7b8-e320-4fda-a41a-b5e4b9443d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.592894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-277df7b8-e320-4fda-a41a-b5e4b9443d34 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:57.594242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-277df7b8-e320-4fda-a41a-b5e4b9443d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:57.624586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:57.677411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 461/897] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:57 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:04:57.695593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f86d1-2fa8-4a9c-ba83-2136e63b8e2a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:57.817625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f86d1-2fa8-4a9c-ba83-2136e63b8e2a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:57.858645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4565f-72ab-4ae3-b14e-5d812431d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:57.859893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4565f-72ab-4ae3-b14e-5d812431d45d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:57.860383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4565f-72ab-4ae3-b14e-5d812431d45d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:57.860860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4565f-72ab-4ae3-b14e-5d812431d45d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:57.873462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4565f-72ab-4ae3-b14e-5d812431d45d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-29c4565f-72ab-4ae3-b14e-5d812431d45d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:04:57.882171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:57.883086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:04:57.884023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:57.886909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 437/898] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 18 06:04:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:57.893589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df7b8-e320-4fda-a41a-b5e4b9443d34 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.002679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277df7b8-e320-4fda-a41a-b5e4b9443d34 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.038592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.039265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.039554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.039816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.040574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:58.040881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.042161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586c70-0a13-47fc-8cdf-f07e18ab60b0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.042591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.042684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586c70-0a13-47fc-8cdf-f07e18ab60b0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.042684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586c70-0a13-47fc-8cdf-f07e18ab60b0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.044331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 438/899] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:58.049648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32f4b-fbd1-4d91-b7c8-79bc19eb666f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.049939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32f4b-fbd1-4d91-b7c8-79bc19eb666f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.050220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed32f4b-fbd1-4d91-b7c8-79bc19eb666f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.051268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 462/900] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 18 06:04:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:58.056902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.072346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6ed32f4b-fbd1-4d91-b7c8-79bc19eb666f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:58.073716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6ed32f4b-fbd1-4d91-b7c8-79bc19eb666f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:58.087762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:58.097588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:58.171851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 439/901] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:04:58.180308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd5cb3-c860-4a16-ae7b-fc00c8ebea64 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.193492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32f4b-fbd1-4d91-b7c8-79bc19eb666f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.225713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.226632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.226910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.227183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.241256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.242975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:58.261810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:58.263287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:58.264670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:58.264670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:58.264670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:58.264670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:58.264670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 463/902] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:04:58.273869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.321382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed32f4b-fbd1-4d91-b7c8-79bc19eb666f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.366044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.367349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.368039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.368593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.369689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.371808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.383752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:58.388778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:58.389866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 06:04:58.390709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:58.393737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 440/903] 10.222.0.27 () {56 vars in 1132 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:58.399226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.414520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62570952-6077-4ef9-9704-14c3e62b8655 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.427056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:58.455302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.456372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.456882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.457369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.458292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:58.458791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.460377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.474686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 464/904] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:58.480225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.567376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e03fe-c245-4849-9a0b-7af7df18206b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.607772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.608452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.608744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.609052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.609802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:58.610186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.611694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.614274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf78a0-7654-495d-bbb4-e6796035eda9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.621017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 441/905] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:58.622981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.657064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.658251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.658772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.659249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.662886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:58.668111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.669993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:04:58.687274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:58.688224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:04:58.689621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:58.691923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 465/906] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:58.697825 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.729231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:58.752016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4182e-f5f0-4bb2-87c7-61da513ce3d6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.801005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.801005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.801005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.801005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.801439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:58.801439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.801439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.805520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 442/907] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:58.811731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.824555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bf8a9-86cc-4a46-9d39-9e6fc8c21c93 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.866412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.867106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.867429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.867878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.868812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:58.869120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.870572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:58.892190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 466/908] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:58.898035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:58.922762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d5546-0da6-4037-880a-bb77af5f7a82 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:58.959733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:58.960627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:58.961102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:58.961546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:58.962462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:58.963005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:58.964153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:59.011353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adcb1b5-7b8d-4b24-a932-0524d6e4cff4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:59.048005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:59.048623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.048912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.049225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.089361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 443/909] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:04:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:04:59.131609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:59.133285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:59.197185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:59.255855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:59.256866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 467/910] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:04:58 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 06:04:59.259082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:59.386458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b483579-bc6b-439e-8967-b2da4de97a6b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:59.422942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab1dae-cf95-4c57-b5b0-ab5ffa4908c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:59.424132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1dae-cf95-4c57-b5b0-ab5ffa4908c3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.424644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1dae-cf95-4c57-b5b0-ab5ffa4908c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.425216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab1dae-cf95-4c57-b5b0-ab5ffa4908c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.438213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab1dae-cf95-4c57-b5b0-ab5ffa4908c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:59.440007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab1dae-cf95-4c57-b5b0-ab5ffa4908c3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-4fab1dae-cf95-4c57-b5b0-ab5ffa4908c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:04:59.459126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:59.460096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:59.461051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:04:59.461051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:04:59.461051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:04:59.461051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:04:59.463382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 444/911] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:59.470099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:59.490828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc89d-28c9-47af-a8bc-beef6adfdec4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.491450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc89d-28c9-47af-a8bc-beef6adfdec4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.491956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc89d-28c9-47af-a8bc-beef6adfdec4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.494023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 445/912] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:59.501517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449bff-68c9-4ec7-9414-3b242c3fdd76 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.502098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449bff-68c9-4ec7-9414-3b242c3fdd76 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.502587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34449bff-68c9-4ec7-9414-3b242c3fdd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.520565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-34449bff-68c9-4ec7-9414-3b242c3fdd76 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:59.522175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-34449bff-68c9-4ec7-9414-3b242c3fdd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:59.577374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:59.582927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec95d6a7-f6bd-43f2-a2ab-71908516968e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:59.605344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 446/913] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:04:59.621200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34449bff-68c9-4ec7-9414-3b242c3fdd76 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:59.621410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:59.621855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.622204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.622483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.623219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:04:59.623528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:59.624904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:59.643432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 468/914] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:04:59.646276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:59.667486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:59.760681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34449bff-68c9-4ec7-9414-3b242c3fdd76 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:59.768124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf81b7-def4-4970-9dc1-01fa78e27806 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:04:59.802739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153438ad-2d15-493f-a307-f63e57c0532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:59.803344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153438ad-2d15-493f-a307-f63e57c0532c None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.803631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153438ad-2d15-493f-a307-f63e57c0532c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.803910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153438ad-2d15-493f-a307-f63e57c0532c None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.804913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153438ad-2d15-493f-a307-f63e57c0532c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:59.806386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153438ad-2d15-493f-a307-f63e57c0532c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:59.815134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5fbbb-7f04-4c08-9f29-a88b79139603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:04:59.815946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fbbb-7f04-4c08-9f29-a88b79139603 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.816229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fbbb-7f04-4c08-9f29-a88b79139603 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.816504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5fbbb-7f04-4c08-9f29-a88b79139603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.824404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5fbbb-7f04-4c08-9f29-a88b79139603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:04:59.826396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5fbbb-7f04-4c08-9f29-a88b79139603 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-86b5fbbb-7f04-4c08-9f29-a88b79139603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:04:59.842005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:04:59.843100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:04:59.843985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 469/915] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:04:59.844476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e37bb-ee65-4668-a0d6-6e6943c87c06 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.844918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e37bb-ee65-4668-a0d6-6e6943c87c06 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.845108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e37bb-ee65-4668-a0d6-6e6943c87c06 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.846421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 470/916] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:04:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:04:59.848830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e37bb-ee65-4668-a0d6-6e6943c87c06 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:04:59.884790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 447/917] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:04:59 2022] POST /identity/v3/services => generated 241 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:04:59.886449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fb22-17dc-47d7-a149-9dc159967a06 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:04:59.886978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fb22-17dc-47d7-a149-9dc159967a06 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:04:59.887464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fb22-17dc-47d7-a149-9dc159967a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:04:59.920792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-79f8fb22-17dc-47d7-a149-9dc159967a06 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:04:59.922823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-79f8fb22-17dc-47d7-a149-9dc159967a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:04:59.947842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:59.976536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:04:59.988959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e37bb-ee65-4668-a0d6-6e6943c87c06 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:00.017532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 448/918] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:04:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:00.033548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:00.034634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:00.035118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:00.035607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:00.036752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:00.037380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:00.039313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:00.040158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fb22-17dc-47d7-a149-9dc159967a06 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:00.055284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 471/919] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:00.061967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:00.163572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fb22-17dc-47d7-a149-9dc159967a06 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:00.194209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e5cbbf-c5a4-49c0-b693-f5526f8d3bfb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:00.203083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:00.203942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:00.204227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:00.204502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:00.205337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:00.206872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:00.220407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:00.221462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:00.222294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 449/920] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:05:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:00.228849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:00.235504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:00.243597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:00.244958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:00.245911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:00.246698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:00.247823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] RBAC: Adding query filter params (role.id=b78180a039814a8d8f4264db49c54be5, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=c4d472ed340f4bcdaaf9b30c43b0073c) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:00.248628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:00.251255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:00.259814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 472/921] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:00 2022] GET /identity/v3/role_assignments?user.id=c4d472ed340f4bcdaaf9b30c43b0073c&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=b78180a039814a8d8f4264db49c54be5 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:00.275754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:00.360295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb059c-70e8-4fea-ac5d-7986682d1904 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:00.400702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:00.401430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:00.401714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:00.401997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:00.402724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:00.403029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:00.405482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:00.411724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 450/922] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:05:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:00.417627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:00.531701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67fa8a-5f98-4726-8ae0-95897e861c43 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:00.568515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b644-42f9-4094-8746-d4a61c3bc50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:00.569125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b644-42f9-4094-8746-d4a61c3bc50c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:00.569408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b644-42f9-4094-8746-d4a61c3bc50c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:00.569673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b644-42f9-4094-8746-d4a61c3bc50c None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:00.570372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b644-42f9-4094-8746-d4a61c3bc50c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:00.570675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b644-42f9-4094-8746-d4a61c3bc50c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:00.572092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b644-42f9-4094-8746-d4a61c3bc50c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:00.579651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 473/923] 10.222.0.27 () {56 vars in 1114 bytes} [Mon Jul 18 06:05:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:00.585378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:00.698514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef927f-538b-40b3-b4e4-1a9007efc2e1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:00.707070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:00.737258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d685ff-f11d-4d05-bf4d-0d3fd52105df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:00.737924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d685ff-f11d-4d05-bf4d-0d3fd52105df None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:00.738206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d685ff-f11d-4d05-bf4d-0d3fd52105df None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:00.738479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d685ff-f11d-4d05-bf4d-0d3fd52105df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:00.739217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d685ff-f11d-4d05-bf4d-0d3fd52105df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:00.740664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d685ff-f11d-4d05-bf4d-0d3fd52105df None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:00.845966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 451/924] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:05:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:05:01.272149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7914-407b-4834-9e71-0e0bd2ee985a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:01.273197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7914-407b-4834-9e71-0e0bd2ee985a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:01.273702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c7914-407b-4834-9e71-0e0bd2ee985a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:01.275549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 474/925] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:01.281167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8412b3-9faa-4759-a66f-590f800ae53a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:01.282003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8412b3-9faa-4759-a66f-590f800ae53a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:01.282483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8412b3-9faa-4759-a66f-590f800ae53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:01.300648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fd8412b3-9faa-4759-a66f-590f800ae53a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:01.302178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fd8412b3-9faa-4759-a66f-590f800ae53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:01.382750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 452/926] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:01.404896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7914-407b-4834-9e71-0e0bd2ee985a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:01.474231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:01.521968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c7914-407b-4834-9e71-0e0bd2ee985a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:01.558713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:01.559468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:01.559756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:01.560093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:01.560763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:01.562224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:01.574638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:01.576150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:01.577416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 475/927] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:01.585614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8412b3-9faa-4759-a66f-590f800ae53a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:01.671231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:01.691623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8412b3-9faa-4759-a66f-590f800ae53a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:01.728330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b035bd5-8225-48f7-80dc-1645931abe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:01.729036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035bd5-8225-48f7-80dc-1645931abe68 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:01.729329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035bd5-8225-48f7-80dc-1645931abe68 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:01.729611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b035bd5-8225-48f7-80dc-1645931abe68 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:01.730326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b035bd5-8225-48f7-80dc-1645931abe68 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:01.730638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b035bd5-8225-48f7-80dc-1645931abe68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:01.732328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b035bd5-8225-48f7-80dc-1645931abe68 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:01.737714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 453/928] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:05:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:01.743054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:01.852079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b4558-b2c4-464d-9d49-73001c7482f8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:01.876269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:01.890750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f4343-2650-497b-ac2f-093676b1d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:01.900608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4343-2650-497b-ac2f-093676b1d180 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:01.900608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4343-2650-497b-ac2f-093676b1d180 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:01.900608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f4343-2650-497b-ac2f-093676b1d180 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:01.900608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4343-2650-497b-ac2f-093676b1d180 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:01.900608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4343-2650-497b-ac2f-093676b1d180 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:01.900608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f4343-2650-497b-ac2f-093676b1d180 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:01.901370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 476/929] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:05:01 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:02.035235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601d2c-c943-4f7e-bc16-7347b488db96 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.035572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601d2c-c943-4f7e-bc16-7347b488db96 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.035811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c601d2c-c943-4f7e-bc16-7347b488db96 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.037602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 454/930] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:02.043609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8b34-996f-4696-98f6-8c3b73a7f877 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.044468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8b34-996f-4696-98f6-8c3b73a7f877 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.044721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fd8b34-996f-4696-98f6-8c3b73a7f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.064078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b8fd8b34-996f-4696-98f6-8c3b73a7f877 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:02.065345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8fd8b34-996f-4696-98f6-8c3b73a7f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:02.150949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 477/931] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:02.174592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c601d2c-c943-4f7e-bc16-7347b488db96 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:02.285237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c601d2c-c943-4f7e-bc16-7347b488db96 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:02.321653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011b6cc-ac2b-4f99-93aa-a830aa9c49b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:02.322473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011b6cc-ac2b-4f99-93aa-a830aa9c49b7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.322800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011b6cc-ac2b-4f99-93aa-a830aa9c49b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.323084 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011b6cc-ac2b-4f99-93aa-a830aa9c49b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.323738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011b6cc-ac2b-4f99-93aa-a830aa9c49b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:02.325219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011b6cc-ac2b-4f99-93aa-a830aa9c49b7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f011b6cc-ac2b-4f99-93aa-a830aa9c49b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:02.337798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:02.338860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:02.339754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 455/932] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:02.346334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd8b34-996f-4696-98f6-8c3b73a7f877 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:02.443963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e85a0e-baca-49b6-aa8e-759d925641be None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.444264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e85a0e-baca-49b6-aa8e-759d925641be None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.444470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e85a0e-baca-49b6-aa8e-759d925641be None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.447196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 456/933] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:02.451721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94fbd-3e26-4abf-9767-974a0b325ff3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.452011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94fbd-3e26-4abf-9767-974a0b325ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.452288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a94fbd-3e26-4abf-9767-974a0b325ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.455368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fd8b34-996f-4696-98f6-8c3b73a7f877 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:02.470019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-99a94fbd-3e26-4abf-9767-974a0b325ff3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:02.471227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-99a94fbd-3e26-4abf-9767-974a0b325ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:02.473501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:02.481949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:02.506368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:02.507357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.507845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.508305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.509234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:02.509728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:02.511284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:02.522301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 478/934] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:02.530970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:02.552386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 457/935] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:02.575521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94fbd-3e26-4abf-9767-974a0b325ff3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:02.669676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26b443-6a2c-4985-9311-0dd43998f424 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:02.689913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a94fbd-3e26-4abf-9767-974a0b325ff3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:02.717901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:02.719156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.719883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.720854 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.722289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:02.723052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:02.725423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:02.728756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:02.729607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.729884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.730164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.733898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 479/936] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:02.739257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:02.743322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:02.747586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:02.755815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:02.756745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:02.757622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:02.761948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 458/937] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:02.763439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:02.795466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:02.864933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff56459-6206-4ef8-9eac-5b13ce901d41 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:02.880702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffcc188-82a8-449e-a7f8-c2dd9ebd6435 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:02.908760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:02.909809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.910242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.910954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.912512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] RBAC: Adding query filter params (interface=public, service_id=76c582c5aa804d479e4f3abdfc600d89, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:02.913174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:02.915358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:02.923552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 480/938] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/endpoints?service_id=76c582c5aa804d479e4f3abdfc600d89&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:02.929643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:02.929643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:02.929643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:02.929643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:02.930071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:02.930071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:02.930237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:02.930322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:02.947897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 459/939] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:02.949343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.025764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:03.042839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb59f8e-f0fa-4f30-8f07-558621e34ae8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.052784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:03.074639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a38029-82be-41eb-8495-e9fc2e1cc1aa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.079026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69168bfd-33d5-44d1-b291-aa808fc992dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.079863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168bfd-33d5-44d1-b291-aa808fc992dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.079987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168bfd-33d5-44d1-b291-aa808fc992dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.080236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69168bfd-33d5-44d1-b291-aa808fc992dd None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.080919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69168bfd-33d5-44d1-b291-aa808fc992dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.082327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69168bfd-33d5-44d1-b291-aa808fc992dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.088749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 481/940] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:05:03.090165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85189-20d9-43d6-a3b7-bec82f6380b1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.090458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85189-20d9-43d6-a3b7-bec82f6380b1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.091406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a85189-20d9-43d6-a3b7-bec82f6380b1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.097844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 482/941] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:03.099368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28505eef-519d-4f03-9775-4d2cbdb34cab None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.099729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28505eef-519d-4f03-9775-4d2cbdb34cab None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.100008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28505eef-519d-4f03-9775-4d2cbdb34cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.119337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-28505eef-519d-4f03-9775-4d2cbdb34cab None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:03.120615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-28505eef-519d-4f03-9775-4d2cbdb34cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:03.137915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.140296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.140838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.141637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.160113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.162949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:03.184684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:03.186258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:03.187142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:03.187142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:03.187142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:03.187142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:03.191250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 460/942] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:03.192236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.226866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 483/943] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:03.253809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28505eef-519d-4f03-9775-4d2cbdb34cab None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.332038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d335ebf-0d1a-4bba-8dcf-76ab63b0b505 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.346113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:03.373277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.374733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.375516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.376031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.377246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:03.378240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.380147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.398777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 461/944] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:03.399468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28505eef-519d-4f03-9775-4d2cbdb34cab None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.401207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:03.404396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.439946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.441066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.441553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.442060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.442980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.444639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.446247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING keystone.server.flask.common [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 06:05:03.494634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.sql.core [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 06:05:03.494634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 06:05:03.494634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [parameters: {'id': '2a59d1392c0e4e619981e83e989058af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 06:05:03.494634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80452) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a59d1392c0e4e619981e83e989058af.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a59d1392c0e4e619981e83e989058af. Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 06:05:03.513366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 06:05:03.514338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application yield resource Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application next(self.gen) Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise self.value Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application session.commit() Jul 18 06:05:03.515285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.session.flush() Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application compat.raise_( Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 06:05:03.516190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 06:05:03.517130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application conn.query(q) Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application result.read() Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 06:05:03.517914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [parameters: {'id': '2a59d1392c0e4e619981e83e989058af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:03.520486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:03.522347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2a59d1392c0e4e619981e83e989058af. Jul 18 06:05:03.524560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.527578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 484/945] 10.222.0.27 () {60 vars in 1140 bytes} [Mon Jul 18 06:05:03 2022] POST /identity/v3/projects => generated 262 bytes in 274 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:03.535493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.537503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92734e-2f87-4192-915d-5a8daf523bda None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.588222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.588962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.589291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.589569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.600005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.601816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:05:03.622040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:03.623850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:05:03.625002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:03.628292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 462/946] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:05:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:03.629583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.673284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:03.697733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b8eb4-62f8-4843-ab6e-230c6277125f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.751034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.752034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.752218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.752450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.760415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.762166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.771845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782eb677-22f4-4993-82ae-ff1f72fc5280 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:05:03.783009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:03.783974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:03.784875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:03.789365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 485/947] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:03.790414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.812303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:03.827065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.834030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.834030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.834030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.834030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:03.834030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.834030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.865211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 463/948] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 18 06:05:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:03.866137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:03.927184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae1348-da64-4649-a734-7d5e310ab1d0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:03.969935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:03.970473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:03.972086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:03.972533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:03.973000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:03.973950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:03.974406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:03.976032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:03.981097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79988991-7b2e-41de-8755-67ff8cf564a5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:04.009887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 486/949] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:05:03 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:04.023626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9c618-65f8-46de-84e8-85b185725358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:04.024467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c618-65f8-46de-84e8-85b185725358 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.024755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c618-65f8-46de-84e8-85b185725358 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.025079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9c618-65f8-46de-84e8-85b185725358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.038398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9c618-65f8-46de-84e8-85b185725358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:04.039974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9c618-65f8-46de-84e8-85b185725358 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-afa9c618-65f8-46de-84e8-85b185725358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:04.061826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:04.062859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:04.063740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:04.063740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:04.063740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:04.063740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:04.063740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 464/950] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:04.069432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:04.087837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378cf54-d773-4bde-a4e7-bb8bbd408794 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.088049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378cf54-d773-4bde-a4e7-bb8bbd408794 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.088270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378cf54-d773-4bde-a4e7-bb8bbd408794 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.089756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 465/951] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:04.095828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519c5a-1324-4b91-bd69-e710ab5eb4b3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.096172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519c5a-1324-4b91-bd69-e710ab5eb4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.096387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a519c5a-1324-4b91-bd69-e710ab5eb4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.115540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6a519c5a-1324-4b91-bd69-e710ab5eb4b3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:04.116682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6a519c5a-1324-4b91-bd69-e710ab5eb4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:04.180834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:04.214308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428b540-00c0-4153-8b52-c65394a82b2b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:04.216572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 466/952] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:04.240579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a519c5a-1324-4b91-bd69-e710ab5eb4b3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:04.253878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:04.254704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.255086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.255467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.256297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:04.256704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:04.259206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:04.273689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 487/953] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:04.280853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:04.336933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:04.378089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a519c5a-1324-4b91-bd69-e710ab5eb4b3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:04.417506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaf238-302d-4fff-ac16-a0a7068c8dfb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:04.427244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:04.428062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.428423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.428774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.430343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:04.432226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:04.458606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:04.459651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.460083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.469157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.469157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:04.469939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:04.471885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:05:04.485355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:04.486324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:04.487349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 488/954] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:04.492364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:04.527801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 467/955] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:05:04 2022] POST /identity/v3/services => generated 242 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:05:04.610012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97dfe2-6eed-4186-a6b9-914eb477d5dd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:04.661166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1317be65-1377-4f41-a84a-651afb8cc77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:04.661942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317be65-1377-4f41-a84a-651afb8cc77b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.662340 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317be65-1377-4f41-a84a-651afb8cc77b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.662686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1317be65-1377-4f41-a84a-651afb8cc77b None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.663562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317be65-1377-4f41-a84a-651afb8cc77b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:04.663947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317be65-1377-4f41-a84a-651afb8cc77b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:04.665529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1317be65-1377-4f41-a84a-651afb8cc77b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:04.685145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 489/956] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:05:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:04.690112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:04.811975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e357bcb9-2525-484e-9a72-909c3e7bc95b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:04.843557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:04.849445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd82d16-f36a-43bd-bb21-343233b74079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:04.850397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82d16-f36a-43bd-bb21-343233b74079 None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:04.850678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82d16-f36a-43bd-bb21-343233b74079 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:04.851019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd82d16-f36a-43bd-bb21-343233b74079 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/c4d472ed340f4bcdaaf9b30c43b0073c/roles/b78180a039814a8d8f4264db49c54be5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:04.853423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82d16-f36a-43bd-bb21-343233b74079 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=c4d472ed340f4bcdaaf9b30c43b0073c, role_id=b78180a039814a8d8f4264db49c54be5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:04.854858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd82d16-f36a-43bd-bb21-343233b74079 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:04.965224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 468/957] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:05:04 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/c4d472ed340f4bcdaaf9b30c43b0073c/roles/b78180a039814a8d8f4264db49c54be5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:05:05.648783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87c74-e9fb-42d6-a3c2-9b97989a1dcf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:05.649327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87c74-e9fb-42d6-a3c2-9b97989a1dcf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:05.649415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb87c74-e9fb-42d6-a3c2-9b97989a1dcf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:05.650724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 490/958] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:05.657106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58399-b0e5-4b94-a63c-19f613b7b2ad None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:05.657531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58399-b0e5-4b94-a63c-19f613b7b2ad None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:05.657715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d58399-b0e5-4b94-a63c-19f613b7b2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:05.675902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-86d58399-b0e5-4b94-a63c-19f613b7b2ad None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:05.677160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-86d58399-b0e5-4b94-a63c-19f613b7b2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:05.751420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 469/959] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:05.774872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87c74-e9fb-42d6-a3c2-9b97989a1dcf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:05.835528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:05.884141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb87c74-e9fb-42d6-a3c2-9b97989a1dcf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:05.919887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:05.920604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:05.920886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:05.921190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:05.921844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:05.923206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:05.936635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:05.937792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:05.938662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 491/960] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:05:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:05.944345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58399-b0e5-4b94-a63c-19f613b7b2ad None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:06.047674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d58399-b0e5-4b94-a63c-19f613b7b2ad None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:06.081671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:06.101829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049bfbf-86b1-4f76-b411-f1872e157245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:06.102972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049bfbf-86b1-4f76-b411-f1872e157245 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.103427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049bfbf-86b1-4f76-b411-f1872e157245 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.103877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049bfbf-86b1-4f76-b411-f1872e157245 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.105201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049bfbf-86b1-4f76-b411-f1872e157245 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:06.105738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049bfbf-86b1-4f76-b411-f1872e157245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:06.108809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049bfbf-86b1-4f76-b411-f1872e157245 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:06.119144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 470/961] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:06.126097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:06.194235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ee6-6dc8-433a-91f7-59047adcbe75 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.194433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ee6-6dc8-433a-91f7-59047adcbe75 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.194701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b8ee6-6dc8-433a-91f7-59047adcbe75 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.196451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 471/962] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:06.202519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c619-5844-4f66-aaaa-94b674354703 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.202867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c619-5844-4f66-aaaa-94b674354703 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.203082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940c619-5844-4f66-aaaa-94b674354703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.227293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5940c619-5844-4f66-aaaa-94b674354703 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:06.229813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5940c619-5844-4f66-aaaa-94b674354703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:06.254862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02752e03-b639-46d0-b983-d3556c1d7902 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:06.274487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:06.306597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:06.306706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.307019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.307270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.307991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:06.309969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:06.311597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:06.319170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 492/963] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:06.324372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:06.332718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 472/964] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:06.358137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940c619-5844-4f66-aaaa-94b674354703 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:06.454615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341363e-bb78-4a0d-97f6-038a8c8d1ab0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:06.477351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940c619-5844-4f66-aaaa-94b674354703 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:06.495902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:06.500474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:06.501173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.501464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.501747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.502799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:06.504962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:06.518617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:06.519726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.520209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.520733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.521718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:06.523411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:06.525035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING keystone.server.flask.common [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 06:05:06.581126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.sql.core [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 06:05:06.581126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 06:05:06.581126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [parameters: {'user_id': '4896b886d11445e7afbf2a870f7d9f99', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 06:05:06.581126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80451) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-7490fc77-3566-4fd5-a14c-ca28c40696fe None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 18 06:05:06.592351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 06:05:06.593691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application yield resource Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application next(self.gen) Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise self.value Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application session.commit() Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 06:05:06.594734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.session.flush() Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application compat.raise_( Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 06:05:06.595610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 06:05:06.597051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application conn.query(q) Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application result.read() Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 06:05:06.597917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [parameters: {'user_id': '4896b886d11445e7afbf2a870f7d9f99', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:06.598743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 06:05:06.599619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 06:05:06.600560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 06:05:06.600560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 06:05:06.600560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 06:05:06.600560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 06:05:06.600560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 06:05:06.600560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:06.600905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 493/965] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:05:06 2022] POST /identity/v3/endpoints => generated 349 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:05:06.609078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 473/966] 10.222.0.27 () {60 vars in 1131 bytes} [Mon Jul 18 06:05:06 2022] POST /identity/v3/users => generated 160 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:06.611651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:06.664055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:06.713964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac751-539e-481e-815c-190773636e12 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.715359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac751-539e-481e-815c-190773636e12 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.716778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829ac751-539e-481e-815c-190773636e12 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.723481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 474/967] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:06.729607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319551e0-d4ad-40f7-baaa-9b9af7bb2251 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.729936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319551e0-d4ad-40f7-baaa-9b9af7bb2251 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.730166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319551e0-d4ad-40f7-baaa-9b9af7bb2251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.751302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-319551e0-d4ad-40f7-baaa-9b9af7bb2251 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:06.751885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5462830-a8e1-4fce-96a3-2975940ff3d1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:06.752895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-319551e0-d4ad-40f7-baaa-9b9af7bb2251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:06.799956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:06.801258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.801742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.802199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.814065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:06.815393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:05:06.835874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:06.836866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:06.837862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 494/968] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:05:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:06.843603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:06.858111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 475/969] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:06.880737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319551e0-d4ad-40f7-baaa-9b9af7bb2251 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:06.953587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a062b-ae5d-4cff-8e63-02fe253a8640 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:06.969442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:06.989335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:06.990025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:06.990313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:06.990594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:06.991461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:06.991730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:06.993396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.019171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319551e0-d4ad-40f7-baaa-9b9af7bb2251 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.031769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:07.039715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 495/970] 10.222.0.27 () {56 vars in 1101 bytes} [Mon Jul 18 06:05:06 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:07.064091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016bbad4-ab68-4b26-b1f5-74d26071279f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.065125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bbad4-ab68-4b26-b1f5-74d26071279f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.065517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bbad4-ab68-4b26-b1f5-74d26071279f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.065895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016bbad4-ab68-4b26-b1f5-74d26071279f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.066685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bbad4-ab68-4b26-b1f5-74d26071279f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:07.068831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016bbad4-ab68-4b26-b1f5-74d26071279f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-016bbad4-ab68-4b26-b1f5-74d26071279f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:07.082886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:07.086562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:07.087431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 476/971] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:07.091157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.159982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399f04-1a24-4372-a202-e1bdfe3ce496 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.160340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399f04-1a24-4372-a202-e1bdfe3ce496 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.160551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2399f04-1a24-4372-a202-e1bdfe3ce496 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.162302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 477/972] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:07.168357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed10a-185c-414d-b49d-9cc321609a6d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.169709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed10a-185c-414d-b49d-9cc321609a6d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.170187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ed10a-185c-414d-b49d-9cc321609a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.194399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b21ed10a-185c-414d-b49d-9cc321609a6d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:07.195758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b21ed10a-185c-414d-b49d-9cc321609a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:07.219344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f175f9-a412-4444-8e35-79193764acff None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.261882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.263030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.263335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.263604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.264433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:07.264742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:07.266704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.273510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 496/973] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:07.279976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.285038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 478/974] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:07.307679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:07.309883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed10a-185c-414d-b49d-9cc321609a6d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.408167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b10f19-bea1-4d36-81bd-33cba60e4b69 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.431712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ed10a-185c-414d-b49d-9cc321609a6d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.433504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:07.446171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.446850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.447138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.447416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.448133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:07.448442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:07.449853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.461164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 497/975] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:07.462089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.474754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.475565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.475847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.476124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.487500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:07.495554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:07.496516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:07.502066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 479/976] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:07.504004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.552478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:07.572660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e77ab-a97f-49e4-86e5-1cf17ec65bc2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.609210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.609875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.610161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.610437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.611240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] RBAC: Adding query filter params (interface=public, service_id=9527fad9da9e461bbd9edcb3d62acc27, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:07.611560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:07.612952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.613726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab3e85-86b7-431a-be21-a146e94f18d5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.623194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 498/977] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/endpoints?service_id=9527fad9da9e461bbd9edcb3d62acc27&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:07.624644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.658162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.658828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.659115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.659387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.660280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:07.660587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:07.661981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.671572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 480/978] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:07.677174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.707328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:07.735685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915366d-c3de-4de3-b088-80eced1357a0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.774742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.775475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.775789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.776048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.776757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:07.778752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.797012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 499/979] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:05:07.814352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6890cb-a0d0-491d-a68b-6fe046838ff6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:07.857674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:07.858497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:07.858787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:07.859067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:07.874573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:07.876092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:07.896175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:07.897257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:07.898184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:07.898184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:07.898184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:07.898184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:07.902316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 481/980] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:07.904892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:07.917128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:08.014893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf135c2-2bc6-44c0-87a5-b3c2e303e858 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:08.050494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:08.051208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:08.051535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:08.051812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:08.052534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:08.052836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:08.054469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:08.070970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 500/981] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:08.072535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:08.156675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:08.180996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcb7bb-f284-44cd-a562-b1f79e239810 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:08.217645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:08.218462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:08.218750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:08.219030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:08.227221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:08.228660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:05:08.243974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:08.245446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 06:05:08.246404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:08.249068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 482/982] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:05:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:08.251552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:08.328364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:08.362394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab834a9-7fd1-416a-987b-558646219014 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:08.399247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:08.399929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:08.400213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:08.400485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:08.401358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:08.401670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:08.403257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:08.426512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 501/983] 10.222.0.27 () {56 vars in 1149 bytes} [Mon Jul 18 06:05:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:08.428373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:08.532719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5a7f6-8a6e-4980-ba37-dbb2c3e483b4 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:08.567798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b91deb3-4b49-4ba1-9acb-a4deb8c94efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:08.568503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91deb3-4b49-4ba1-9acb-a4deb8c94efa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:08.568793 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91deb3-4b49-4ba1-9acb-a4deb8c94efa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:08.569101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b91deb3-4b49-4ba1-9acb-a4deb8c94efa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:08.572573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:08.640126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91deb3-4b49-4ba1-9acb-a4deb8c94efa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:08.641552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b91deb3-4b49-4ba1-9acb-a4deb8c94efa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:08.751384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 483/984] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:08 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:05:08.753455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:08.760386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83849af9-d4e1-4926-8e20-45f0f7cdc6d8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:08.760687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83849af9-d4e1-4926-8e20-45f0f7cdc6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:08.760959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83849af9-d4e1-4926-8e20-45f0f7cdc6d8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:08.763518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 484/985] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:08.769012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab4eb4-1c95-4faf-ad64-3867f4780749 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:08.769302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab4eb4-1c95-4faf-ad64-3867f4780749 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:08.769588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab4eb4-1c95-4faf-ad64-3867f4780749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:08.787317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-32ab4eb4-1c95-4faf-ad64-3867f4780749 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:08.788604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-32ab4eb4-1c95-4faf-ad64-3867f4780749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:08.820340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:08.864055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 485/986] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:08.872657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524d83c-901c-4c36-b323-82247ebc37a7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:08.886182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab4eb4-1c95-4faf-ad64-3867f4780749 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:08.906728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:08.916934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:08.919719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:08.919719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:08.919719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:08.931157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:08.932845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:08.952563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:08.953660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:08.954743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:08.954743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:08.954743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:08.954743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:08.956315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 502/987] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:08.961809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:08.991826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab4eb4-1c95-4faf-ad64-3867f4780749 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.028703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.029815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.030095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.030367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.031017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.032380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:09.046759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:09.047785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:09.048728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 486/988] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:05:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:09.053762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:09.068614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7608-1936-4f5d-930d-9e739e35241d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.091219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:09.104511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.105194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.105477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.105751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.106845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:09.107171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.108525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.120151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 503/989] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:09.126338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:09.168379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:09.178724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87a7c8-c93a-4b7c-89bd-962a2257ba29 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.214218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.214874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.215163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.215438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.216264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:09.216679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.218081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.223026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 487/990] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:09.228592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:09.236716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d871ea-e68d-462c-bd06-f3a934f27356 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.274411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.275617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.276075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.276597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.284671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.286657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:05:09.305238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:09.306091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:09.306977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 504/991] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:09.312818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:09.335203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:09.342455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef5a46-867e-464a-b704-0b723892bb32 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.377410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.378118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.378403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.378685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.379386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:09.379692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.381089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.387042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 488/992] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:09.393365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:09.423221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:09.426992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16d09f7-c306-460f-90e4-74cc648ece6b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.463758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.464419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.464703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.465000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.465834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:09.466143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.467706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.479782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 505/993] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:09.486963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:09.510260 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdea11c-8a8a-4f02-8e2c-383507b55fd8 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.545628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.546294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.546581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.546862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.547661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] RBAC: Adding query filter params (interface=admin, service_id=76c582c5aa804d479e4f3abdfc600d89, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:09.547977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.549375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.554908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 489/994] 10.222.0.27 () {56 vars in 1249 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/endpoints?service_id=76c582c5aa804d479e4f3abdfc600d89&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:09.561371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:09.589212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:09.603036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac470e-3b89-4e89-a6aa-c71cef3915fc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.643190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12a0e3-4373-44a9-9e6d-2c61312c6e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.643851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12a0e3-4373-44a9-9e6d-2c61312c6e29 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.644136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12a0e3-4373-44a9-9e6d-2c61312c6e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.644413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12a0e3-4373-44a9-9e6d-2c61312c6e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.645272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12a0e3-4373-44a9-9e6d-2c61312c6e29 None admin] RBAC: Adding query filter params (role.id=b78180a039814a8d8f4264db49c54be5, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=c4d472ed340f4bcdaaf9b30c43b0073c) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:09.645588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12a0e3-4373-44a9-9e6d-2c61312c6e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.647016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12a0e3-4373-44a9-9e6d-2c61312c6e29 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.665191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 506/995] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/role_assignments?user.id=c4d472ed340f4bcdaaf9b30c43b0073c&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=b78180a039814a8d8f4264db49c54be5 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:09.677921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7375f5-c159-4e93-adb4-9bdb6d895289 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:09.720023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f49ea9-937c-4a8e-90d1-2d9a275f2ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:09.720715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f49ea9-937c-4a8e-90d1-2d9a275f2ded None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.721023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f49ea9-937c-4a8e-90d1-2d9a275f2ded None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.721306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f49ea9-937c-4a8e-90d1-2d9a275f2ded None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.722000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f49ea9-937c-4a8e-90d1-2d9a275f2ded None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:09.723511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f49ea9-937c-4a8e-90d1-2d9a275f2ded None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:09.731112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 490/996] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:05:09.855559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed643d-cb61-4b68-b1d4-06c8f2794a69 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.856874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed643d-cb61-4b68-b1d4-06c8f2794a69 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.856874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed643d-cb61-4b68-b1d4-06c8f2794a69 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.858158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 507/997] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:09.864296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180c82-03b1-42e2-83ec-aaaad73ab746 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:09.864820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180c82-03b1-42e2-83ec-aaaad73ab746 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:09.864910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76180c82-03b1-42e2-83ec-aaaad73ab746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:09.883789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-76180c82-03b1-42e2-83ec-aaaad73ab746 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:09.885105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-76180c82-03b1-42e2-83ec-aaaad73ab746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:09.964588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 491/998] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:09.988848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed643d-cb61-4b68-b1d4-06c8f2794a69 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:10.017328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:10.105058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed643d-cb61-4b68-b1d4-06c8f2794a69 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:10.146623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:10.147415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:10.147704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:10.147989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:10.148647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:10.150101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:10.162580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:10.164462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:10.166061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 508/999] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:10.176142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76180c82-03b1-42e2-83ec-aaaad73ab746 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:10.202308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:10.307855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76180c82-03b1-42e2-83ec-aaaad73ab746 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:10.347252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:10.348078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:10.348471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:10.348856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:10.349713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:10.350143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:10.351621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:10.361157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 492/1000] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:05:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:10.364001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:10.462233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:10.479779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8aafd3-8ee7-4771-aecd-74609ddf48f5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:10.517964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd5f46-592c-4456-b738-22b3ac0ed75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:10.518638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5f46-592c-4456-b738-22b3ac0ed75a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:10.518924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5f46-592c-4456-b738-22b3ac0ed75a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:10.519201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd5f46-592c-4456-b738-22b3ac0ed75a None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:10.519919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd5f46-592c-4456-b738-22b3ac0ed75a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:10.520235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd5f46-592c-4456-b738-22b3ac0ed75a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:10.521778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd5f46-592c-4456-b738-22b3ac0ed75a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:10.527377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 509/1001] 10.222.0.27 () {56 vars in 1112 bytes} [Mon Jul 18 06:05:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:10.533669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:10.617984 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:10.640043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acd4259-2517-4829-bb52-48a7c5a90f8a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:10.677033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472697bc-8fbf-42c8-8ad3-f34e664f3e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:10.678023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472697bc-8fbf-42c8-8ad3-f34e664f3e6a None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:10.678457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472697bc-8fbf-42c8-8ad3-f34e664f3e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:10.678886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472697bc-8fbf-42c8-8ad3-f34e664f3e6a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:10.680263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472697bc-8fbf-42c8-8ad3-f34e664f3e6a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:10.681834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472697bc-8fbf-42c8-8ad3-f34e664f3e6a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:10.807965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 493/1002] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:05:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:05:11.792808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4caa-548d-45b6-859b-6443be7c0c2f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:11.793373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4caa-548d-45b6-859b-6443be7c0c2f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:11.793373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de4caa-548d-45b6-859b-6443be7c0c2f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:11.795656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 510/1003] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:11.800901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aef6e-d2ee-4331-8d3c-3c98c11fcd73 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:11.801423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aef6e-d2ee-4331-8d3c-3c98c11fcd73 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:11.801498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54aef6e-d2ee-4331-8d3c-3c98c11fcd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:11.814469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3aef-1ba6-47bc-8835-d067b837bb81 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:11.814783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3aef-1ba6-47bc-8835-d067b837bb81 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:11.815030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716b3aef-1ba6-47bc-8835-d067b837bb81 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:11.816528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 511/1004] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:11.820274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d54aef6e-d2ee-4331-8d3c-3c98c11fcd73 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:11.821269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d54aef6e-d2ee-4331-8d3c-3c98c11fcd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:11.821459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79651102-d563-4669-b538-ae221cd6370e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:11.821712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79651102-d563-4669-b538-ae221cd6370e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:11.821993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79651102-d563-4669-b538-ae221cd6370e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:11.839332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-79651102-d563-4669-b538-ae221cd6370e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:11.840931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-79651102-d563-4669-b538-ae221cd6370e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:11.904773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 494/1005] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:11 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:11.913905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 512/1006] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:11 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:11.928054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aef6e-d2ee-4331-8d3c-3c98c11fcd73 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:11.938696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79651102-d563-4669-b538-ae221cd6370e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:11.998210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:12.024143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:12.043276 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54aef6e-d2ee-4331-8d3c-3c98c11fcd73 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:12.047170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79651102-d563-4669-b538-ae221cd6370e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:12.084175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:12.085023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.085360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.085639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] PATH_INFO: `/v3/services/image` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.086304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:12.087674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:12.091244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:12.092740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.093309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.094062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.094921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:12.096490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:12.100197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:12.101242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:12.102086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 513/1007] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 18 06:05:11 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:12.108271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:12.116072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:12.117370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 06:05:12.118211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:12.118959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 495/1008] 10.222.0.27 () {56 vars in 1126 bytes} [Mon Jul 18 06:05:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:12.128520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:12.243858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c626d7-caaa-4281-91af-2210b7875afc None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:12.261373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bfe1a7-6e63-4ca7-8594-01efb623ee12 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:12.287751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:12.288419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.288698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.288971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.289713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] RBAC: Adding query filter params (name=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:12.290024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:12.291399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:12.298987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 514/1009] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:12.305939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:12.307207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:12.318735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:12.319417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.319717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.320013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.320715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:12.321085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:12.321809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:12.323343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:12.329694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 496/1010] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:12.335194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:12.429592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c15da-6c5e-4ce6-9852-67dee8abbd83 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:12.459063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac71605-1c00-4d97-a3a6-662aee13e6e5 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:12.490340 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:12.491523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.492031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.492545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.493839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] RBAC: Adding query filter params (type=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:12.494416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:12.497747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:12.498515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d805ab3-2646-4d5a-9117-8d78ddd97e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:12.499359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d805ab3-2646-4d5a-9117-8d78ddd97e50 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.499815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d805ab3-2646-4d5a-9117-8d78ddd97e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.500234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d805ab3-2646-4d5a-9117-8d78ddd97e50 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.501132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d805ab3-2646-4d5a-9117-8d78ddd97e50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:12.501611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d805ab3-2646-4d5a-9117-8d78ddd97e50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:12.502992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d805ab3-2646-4d5a-9117-8d78ddd97e50 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:12.516743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 515/1011] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:12 2022] GET /identity/v3/services?type=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:12.516954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 497/1012] 10.222.0.27 () {56 vars in 1122 bytes} [Mon Jul 18 06:05:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:12.518985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:12.628200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:12.675951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34798-a713-487d-9442-c65fe7efe0ab None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:12.717128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5bb078-0541-424e-9abe-78d130179e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:12.717810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bb078-0541-424e-9abe-78d130179e02 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.718097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bb078-0541-424e-9abe-78d130179e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.718377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5bb078-0541-424e-9abe-78d130179e02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.719130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bb078-0541-424e-9abe-78d130179e02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:12.720517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5bb078-0541-424e-9abe-78d130179e02 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:12.812114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 516/1013] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:05:12 2022] POST /identity/v3/endpoints => generated 325 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:05:12.987953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff75a3-1d61-427a-9bad-675a3afe4416 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.988742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff75a3-1d61-427a-9bad-675a3afe4416 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.988742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff75a3-1d61-427a-9bad-675a3afe4416 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:12.990238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 498/1014] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:12.995826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04b60-161e-4f27-8cab-183d96ce3128 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:12.996121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04b60-161e-4f27-8cab-183d96ce3128 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:12.996402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04b60-161e-4f27-8cab-183d96ce3128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:13.015918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-30a04b60-161e-4f27-8cab-183d96ce3128 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:13.017160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30a04b60-161e-4f27-8cab-183d96ce3128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:13.117656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 517/1015] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:13.152690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff75a3-1d61-427a-9bad-675a3afe4416 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:13.225529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:13.285011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff75a3-1d61-427a-9bad-675a3afe4416 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:13.331930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:13.332763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:13.333071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:13.333344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:13.346622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:13.354781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:13.355790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:13.362967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 499/1016] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 18 06:05:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:13.366529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04b60-161e-4f27-8cab-183d96ce3128 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:13.432785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:13.486653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04b60-161e-4f27-8cab-183d96ce3128 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:13.538140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:13.538830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:13.539128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:13.539393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:13.540218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:13.540521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:13.542332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:13.565121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 518/1017] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 18 06:05:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:13.567804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:13.764182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16318b-fa3f-415d-a2e5-2158516142d9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:13.792133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:13.831067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:13.832387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:13.832918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:13.833379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:13.852912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:13.857046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:13.887806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:13.889643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:13.891467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:13.891467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:13.891467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:13.891467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:13.893435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 500/1018] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:13.899343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:14.084556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b307516-89dc-488a-a78b-2291d3306459 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:14.121756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:14.146101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:14.147242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:14.147735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:14.148232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:14.149625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:14.150217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:14.152753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:14.171834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 519/1019] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:14.181538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:14.342615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944c704a-c882-46b1-88a3-222f1d9dce6e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:14.382622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:14.383442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:14.383722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:14.384010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:14.393283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:14.394752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:05:14.410753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:14.412566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:14.414393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 501/1020] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:05:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:14.424825 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:14.540841 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d052f-b6b3-41c0-90fb-1512b5870d8d None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:14.580372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c2dfb-902f-4ac5-bda5-b97b195da7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:14.581097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2dfb-902f-4ac5-bda5-b97b195da7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:14.581385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2dfb-902f-4ac5-bda5-b97b195da7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:14.581663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c2dfb-902f-4ac5-bda5-b97b195da7d3 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:14.582678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c2dfb-902f-4ac5-bda5-b97b195da7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:14.582982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c2dfb-902f-4ac5-bda5-b97b195da7d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:14.584566 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c2dfb-902f-4ac5-bda5-b97b195da7d3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:14.613118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 520/1021] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:05:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:14.615856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:14.637282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0dc7c-7b6f-4ba8-80a1-3128ec6c9809 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:14.637947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0dc7c-7b6f-4ba8-80a1-3128ec6c9809 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:14.638419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0dc7c-7b6f-4ba8-80a1-3128ec6c9809 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:14.639826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 521/1022] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:14.645396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e9c83-8fb9-4438-b6fe-39518341775c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:14.645775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e9c83-8fb9-4438-b6fe-39518341775c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:14.646105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e9c83-8fb9-4438-b6fe-39518341775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:14.663454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:14.675020 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0d1e9c83-8fb9-4438-b6fe-39518341775c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:14.677067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0d1e9c83-8fb9-4438-b6fe-39518341775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:14.728360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:14.753108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ca68cb-bf56-4ad1-9296-abb5377ae43e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:14.783912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 522/1023] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:14 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:14.799727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:14.800858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:14.801415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:14.801926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:14.809847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e9c83-8fb9-4438-b6fe-39518341775c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:14.903873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:14.905432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:14.944645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:14.944840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e9c83-8fb9-4438-b6fe-39518341775c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:14.992096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:14.993172 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:14.993680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:14.993982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:14.994695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:14.996080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:15.038055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 502/1024] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:14 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:05:15.044132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:15.109034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 523/1025] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:05:14 2022] POST /identity/v3/services => generated 242 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:05:15.169838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bdd79a-879c-4978-9911-236ed9d44f96 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:15.205998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:15.224928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:15.226017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:15.226435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:15.226857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:15.240258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:15.242059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:15.265377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:15.267174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:15.274551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:15.274551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:15.274551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:15.274551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:15.274551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 503/1026] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:15.275103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:15.322657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:15.413050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604d37e-c561-4c04-b490-c22c7dd7771c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:15.455520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:15.456199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:15.456567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:15.456913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:15.457757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:15.458140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:15.459601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:15.472935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 524/1027] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:15.479024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:15.597913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000407ec-bfd1-44f8-8a6b-b5bfe6a6e749 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:15.640898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cec5e-0a4b-46ed-b14f-bf16c1fa9c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:15.641743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cec5e-0a4b-46ed-b14f-bf16c1fa9c0c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:15.642029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cec5e-0a4b-46ed-b14f-bf16c1fa9c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:15.642307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cec5e-0a4b-46ed-b14f-bf16c1fa9c0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:15.650241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cec5e-0a4b-46ed-b14f-bf16c1fa9c0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:15.651713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cec5e-0a4b-46ed-b14f-bf16c1fa9c0c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-9e7cec5e-0a4b-46ed-b14f-bf16c1fa9c0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:05:15.667437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:15.678002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:15.679903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 504/1028] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:15.683743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:15.690520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b347d-22e6-4307-8788-33e148300c90 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:15.690923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b347d-22e6-4307-8788-33e148300c90 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:15.691083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b347d-22e6-4307-8788-33e148300c90 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:15.692619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 505/1029] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:15.698447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606afbb-6d59-445e-872a-03eea0cd7e04 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:15.698727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606afbb-6d59-445e-872a-03eea0cd7e04 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:15.699045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606afbb-6d59-445e-872a-03eea0cd7e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:15.718628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8606afbb-6d59-445e-872a-03eea0cd7e04 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:15.719742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8606afbb-6d59-445e-872a-03eea0cd7e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:15.796243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:15.846655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:15.864122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8c783-e271-4828-8db1-4104adabe65b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:15.881033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 506/1030] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:15.915214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606afbb-6d59-445e-872a-03eea0cd7e04 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:15.925708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:15.926472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:15.926820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:15.927162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:15.928040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:15.928414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:15.930224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:15.946332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 525/1031] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:15.954209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:16.126762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606afbb-6d59-445e-872a-03eea0cd7e04 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:16.146835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476ad755-9850-4c49-8a39-aa31d0b78e2c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:16.195125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:16.196457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:16.196960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:16.197492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:16.197999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed394d00-4f8d-4dae-8fa3-cecb6707bfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:16.198774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed394d00-4f8d-4dae-8fa3-cecb6707bfaa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:16.199061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed394d00-4f8d-4dae-8fa3-cecb6707bfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:16.199336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed394d00-4f8d-4dae-8fa3-cecb6707bfaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:16.199664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:16.200796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed394d00-4f8d-4dae-8fa3-cecb6707bfaa None admin] RBAC: Adding query filter params (role.id=b78180a039814a8d8f4264db49c54be5, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=065014e1d5984a3db142381ccc62a420) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:16.201141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed394d00-4f8d-4dae-8fa3-cecb6707bfaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:16.202578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed394d00-4f8d-4dae-8fa3-cecb6707bfaa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:16.203058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:16.206407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 507/1032] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:16.211958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:16.221347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 526/1033] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:15 2022] GET /identity/v3/role_assignments?user.id=065014e1d5984a3db142381ccc62a420&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=b78180a039814a8d8f4264db49c54be5 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:16.252943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:16.358640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beded88-24a7-4be9-a7c4-5ea658f08de3 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:16.402333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e632778-f086-4ad6-bd69-6645cd3a9002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:16.403092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632778-f086-4ad6-bd69-6645cd3a9002 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:16.403388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632778-f086-4ad6-bd69-6645cd3a9002 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:16.403670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e632778-f086-4ad6-bd69-6645cd3a9002 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:16.404423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e632778-f086-4ad6-bd69-6645cd3a9002 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:16.405991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e632778-f086-4ad6-bd69-6645cd3a9002 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:16.556811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 508/1034] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:05:16 2022] POST /identity/v3/projects => generated 311 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:05:17.950209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c957-d0d4-47aa-83af-24b95c576276 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:17.950209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c957-d0d4-47aa-83af-24b95c576276 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:17.950867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258c957-d0d4-47aa-83af-24b95c576276 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:17.951939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 527/1035] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:17.959590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569b8c3-0e97-4c00-9bad-06ed50a7d59f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:17.960153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569b8c3-0e97-4c00-9bad-06ed50a7d59f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:17.960361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569b8c3-0e97-4c00-9bad-06ed50a7d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:17.983409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1569b8c3-0e97-4c00-9bad-06ed50a7d59f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:17.984650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1569b8c3-0e97-4c00-9bad-06ed50a7d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:18.072274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 509/1036] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:18.097585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c957-d0d4-47aa-83af-24b95c576276 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:18.129258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:18.263476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258c957-d0d4-47aa-83af-24b95c576276 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:18.307155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf9626-35aa-43b0-8823-8892fc8969af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:18.307951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9626-35aa-43b0-8823-8892fc8969af None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.308246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9626-35aa-43b0-8823-8892fc8969af None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.308525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf9626-35aa-43b0-8823-8892fc8969af None admin] PATH_INFO: `/v3/services/image` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.309813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf9626-35aa-43b0-8823-8892fc8969af None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:18.311545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf9626-35aa-43b0-8823-8892fc8969af None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-82bf9626-35aa-43b0-8823-8892fc8969af None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:18.324272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:18.327502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:18.329932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:18.333126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569b8c3-0e97-4c00-9bad-06ed50a7d59f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:18.333534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 528/1037] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 18 06:05:18 2022] GET /identity/v3/services/image => generated 86 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:18.353786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:18.508096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569b8c3-0e97-4c00-9bad-06ed50a7d59f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:18.532510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae8dab-bb01-455e-9f39-dde0814d933f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.533436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae8dab-bb01-455e-9f39-dde0814d933f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.533881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae8dab-bb01-455e-9f39-dde0814d933f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.536899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 529/1038] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:18.542655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd0b1-fc6a-4928-8d64-8a884f31b3af None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.543021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd0b1-fc6a-4928-8d64-8a884f31b3af None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.543263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cd0b1-fc6a-4928-8d64-8a884f31b3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.554425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:18.555105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.556062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.556344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.557095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:18.557403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:18.558798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:18.562825 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-437cd0b1-fc6a-4928-8d64-8a884f31b3af None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:18.564056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-437cd0b1-fc6a-4928-8d64-8a884f31b3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:18.565289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 510/1039] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:18.570822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:18.642255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 530/1040] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:18.666091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd0b1-fc6a-4928-8d64-8a884f31b3af None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:18.672319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:18.677184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:18.704405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc9d7c-afd9-4c81-a39b-add7b628ced1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:18.758812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80924a19-aaff-4769-bfec-753ee900daac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:18.759523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80924a19-aaff-4769-bfec-753ee900daac None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.759811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80924a19-aaff-4769-bfec-753ee900daac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.760093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80924a19-aaff-4769-bfec-753ee900daac None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.760856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80924a19-aaff-4769-bfec-753ee900daac None admin] RBAC: Adding query filter params (type=image) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:18.761214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80924a19-aaff-4769-bfec-753ee900daac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:18.763512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80924a19-aaff-4769-bfec-753ee900daac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:18.774391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 511/1041] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:18.774391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4d415-a10f-4603-998d-af3023acccb8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.774391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4d415-a10f-4603-998d-af3023acccb8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.774391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4d415-a10f-4603-998d-af3023acccb8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.774391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 512/1042] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:18.776281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4d415-a10f-4603-998d-af3023acccb8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:18.825617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cd0b1-fc6a-4928-8d64-8a884f31b3af None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:18.867008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e92e11f-07b1-46ee-98f9-6fc96afd2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:18.867918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92e11f-07b1-46ee-98f9-6fc96afd2234 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.868207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92e11f-07b1-46ee-98f9-6fc96afd2234 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.868482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e92e11f-07b1-46ee-98f9-6fc96afd2234 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.881334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e92e11f-07b1-46ee-98f9-6fc96afd2234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5e92e11f-07b1-46ee-98f9-6fc96afd2234 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:18.891065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:18.892168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:18.893294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 531/1043] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 18 06:05:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:18.894568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6464-e8c3-434f-851c-2393a5bf067f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.894568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6464-e8c3-434f-851c-2393a5bf067f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.894568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6464-e8c3-434f-851c-2393a5bf067f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.906954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4d415-a10f-4603-998d-af3023acccb8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:18.915415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c85c6464-e8c3-434f-851c-2393a5bf067f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:18.918669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c85c6464-e8c3-434f-851c-2393a5bf067f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:18.946778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:18.947442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:18.947737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:18.948001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:18.948787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] RBAC: Adding query filter params (interface=public, service_id=e8e5222fcbfc47688b7559ae0acfc371, region_id=RegionOne) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:18.949130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:18.951438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:18.958409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 513/1044] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:05:18 2022] GET /identity/v3/endpoints?service_id=e8e5222fcbfc47688b7559ae0acfc371&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:18.959497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:18.969206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:18.985549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:18.993181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 532/1045] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:18.994012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6464-e8c3-434f-851c-2393a5bf067f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.066967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db607240-8bbf-4f9e-9101-6b25d7ee760b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.101193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6464-e8c3-434f-851c-2393a5bf067f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.102978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.103659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.103946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.104226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.105026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:19.105382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.107349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.116108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 514/1046] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 18 06:05:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:19.116963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.142794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.143464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.143752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.144035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.144734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.146150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.165074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 533/1047] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:05:18 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:05:19.165074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.194276 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:19.230179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:19.239680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b9af5-d509-49fc-bb34-d861f1216c28 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.279349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8df75c-e48b-4b40-99e6-578b61752664 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.285222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.286412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.286884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.287365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.289480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.291621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.294997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 515/1048] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:19.300467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.325299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.325520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.325780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.326053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.339738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.341954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:19.361858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:19.362845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:19.363834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:19.363834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:19.363834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:19.363834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:19.363834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 534/1049] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:19.368682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.435305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898460b-2aa0-4d9d-a24e-98d2663df474 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.475726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.476407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.476691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.476966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.477720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.479164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.481420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3a100-0c97-4e13-8026-f1ef3b741825 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.487491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:19.498411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:19.520793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.521487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.521770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.522044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.522798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:19.523099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.524510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.538252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 535/1050] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:19.544157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.618492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 516/1051] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:05:19 2022] POST /identity/v3/users => generated 285 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:05:19.654688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed92c8b-4cbc-4fb1-879f-2102f716be9f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.696176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.697036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.697316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.697600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.708320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.709860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:05:19.726126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:19.727562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:19.728650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 536/1052] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:05:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:19.733790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.855081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3356a43-88af-44f8-a5ce-974d952694c7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:19.895753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:19.896602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:19.897017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:19.897392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:19.899151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:19.899571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:19.901173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:19.920303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 517/1053] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:05:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:19.925809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:19.959951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:20.031719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d1176-f05e-4a82-8fac-31ef34008431 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:20.068487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:20.069317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:20.069603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:20.069878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:20.080524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:20.082008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:20.099914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:20.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:20.102291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:20.102291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:20.102291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:20.102291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:20.105063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 537/1054] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:20.107899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:20.163716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:20.212650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d823c4e6-4d8a-4147-ba14-90414e5f9049 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:20.249917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:20.250592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:20.250877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:20.251156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:20.251884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:20.252192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:20.253604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:20.270819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 518/1055] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:20.272440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:20.374668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:20.391790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099649f-a5d3-465d-934f-9ba9d2a69fd8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:20.428152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:20.428870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:20.429442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:20.429722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:20.437624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:20.439106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:05:20.454582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:20.455564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:20.461216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 538/1056] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:20.463179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:20.582052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed03ac-8484-49f8-acc8-4eb753868c58 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:20.593047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:20.630502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fcfa7-fa5c-4cdb-889a-a796f7c3cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:20.631639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fcfa7-fa5c-4cdb-889a-a796f7c3cbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:20.632154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fcfa7-fa5c-4cdb-889a-a796f7c3cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:20.632665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fcfa7-fa5c-4cdb-889a-a796f7c3cbf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:20.634280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fcfa7-fa5c-4cdb-889a-a796f7c3cbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:20.634859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fcfa7-fa5c-4cdb-889a-a796f7c3cbf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:20.638564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fcfa7-fa5c-4cdb-889a-a796f7c3cbf2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:20.660728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 519/1057] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:20.667535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:20.795455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82daad09-0248-4e19-b040-6b0fc512071b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:20.846652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb66145-3e81-4f24-a350-2cf974d198a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:20.847691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66145-3e81-4f24-a350-2cf974d198a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:20.848012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66145-3e81-4f24-a350-2cf974d198a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:20.848312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb66145-3e81-4f24-a350-2cf974d198a9 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/065014e1d5984a3db142381ccc62a420/roles/b78180a039814a8d8f4264db49c54be5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:20.851635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb66145-3e81-4f24-a350-2cf974d198a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=065014e1d5984a3db142381ccc62a420, role_id=b78180a039814a8d8f4264db49c54be5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:20.853368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb66145-3e81-4f24-a350-2cf974d198a9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:20.942514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 539/1058] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:05:20 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/065014e1d5984a3db142381ccc62a420/roles/b78180a039814a8d8f4264db49c54be5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:05:21.305477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdceb10-27af-435c-a44a-968f4be9844b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:21.306103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdceb10-27af-435c-a44a-968f4be9844b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:21.306103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdceb10-27af-435c-a44a-968f4be9844b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:21.307670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 520/1059] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:21.314028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b036-6709-4923-ad39-155142303d3d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:21.314556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b036-6709-4923-ad39-155142303d3d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:21.314662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de0b036-6709-4923-ad39-155142303d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:21.320615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:21.333112 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0de0b036-6709-4923-ad39-155142303d3d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:21.334312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0de0b036-6709-4923-ad39-155142303d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:21.413076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 540/1060] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:21.436784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdceb10-27af-435c-a44a-968f4be9844b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:21.570991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdceb10-27af-435c-a44a-968f4be9844b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:21.611522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890c75e-a56b-4eba-aacf-8edd9b3412fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:21.612321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c75e-a56b-4eba-aacf-8edd9b3412fe None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:21.612605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c75e-a56b-4eba-aacf-8edd9b3412fe None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:21.612885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890c75e-a56b-4eba-aacf-8edd9b3412fe None admin] PATH_INFO: `/v3/services/image` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:21.613577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890c75e-a56b-4eba-aacf-8edd9b3412fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:21.614965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890c75e-a56b-4eba-aacf-8edd9b3412fe None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6890c75e-a56b-4eba-aacf-8edd9b3412fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:21.629424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:21.630730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 06:05:21.632400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:21.640789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 521/1061] 10.222.0.27 () {56 vars in 1105 bytes} [Mon Jul 18 06:05:21 2022] GET /identity/v3/services/image => generated 86 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:21.641131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0b036-6709-4923-ad39-155142303d3d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:21.811113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de0b036-6709-4923-ad39-155142303d3d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:21.854121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3f9d-c64d-4624-82f5-ad90a84ef6fa None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:21.854354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3f9d-c64d-4624-82f5-ad90a84ef6fa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:21.854564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3f9d-c64d-4624-82f5-ad90a84ef6fa None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:21.855963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 522/1062] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:21.856260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:21.857285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:21.857641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:21.857950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:21.858671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] RBAC: Adding query filter params (name=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:21.858984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:21.860383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:21.861705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:21.862022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0ce5-68ae-49e6-87a0-1c73692dafd8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:21.862308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0ce5-68ae-49e6-87a0-1c73692dafd8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:21.862583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a0ce5-68ae-49e6-87a0-1c73692dafd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:21.869021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 541/1063] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:21.887977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:21.888255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5c0a0ce5-68ae-49e6-87a0-1c73692dafd8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:21.888255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5c0a0ce5-68ae-49e6-87a0-1c73692dafd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:21.920183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:21.971299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 523/1064] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:21.985170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad56957-2e59-4090-aa7a-c22b3857c0af None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:21.994709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0ce5-68ae-49e6-87a0-1c73692dafd8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:22.022207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:22.022873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:22.023153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:22.023428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:22.024134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] RBAC: Adding query filter params (type=image) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:22.024438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:22.025862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:22.036247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 542/1065] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:22.036925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:22.109388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:22.110616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a0ce5-68ae-49e6-87a0-1c73692dafd8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:22.150015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:22.150971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:22.151271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:22.151538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:22.153277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b858d6-093a-42db-b1cc-fd33e5578952 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:22.162825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:22.170621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:22.171590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:22.172440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 524/1066] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:05:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:22.178141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:22.192115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:22.193147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:22.193433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:22.193710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:22.194456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:22.195824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:22.207179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:22.281859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cf285-980e-490f-946e-a22bda13f641 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:22.309009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 543/1067] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:05:22 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:05:22.336229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:22.337002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:22.337311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:22.337580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:22.338348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:22.338658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:22.340056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:22.353197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 525/1068] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:05:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:22.360289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:22.520715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d08201-f547-4823-8961-4e53a7af2dbe None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:22.540006 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:22.558207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:22.559106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:22.560075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:22.560353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] PATH_INFO: `/v3/users/770a24c3ac934a21842aed35675ed088` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:22.574539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] RBAC: Authorizing `identity:get_user(user_id=770a24c3ac934a21842aed35675ed088)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:22.576064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:22.582703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 544/1069] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:22 2022] GET /identity/v3/users/770a24c3ac934a21842aed35675ed088 => generated 285 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:22.584939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:22.677909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:22.697656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eecb2b-e821-4e3c-aac3-3f28fceb4c9a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:22.736290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:22.736950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:22.737261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:22.737539 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:22.806589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:22.808095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:22.893200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:22.917089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 526/1070] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:05:22.921224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:23.021560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19594a85-2d5e-4c56-9946-41c4cbd6533c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:23.055993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8819d3-ec0b-4f2c-ad2e-437d4e7781b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:23.056853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8819d3-ec0b-4f2c-ad2e-437d4e7781b4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.057161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8819d3-ec0b-4f2c-ad2e-437d4e7781b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.057435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8819d3-ec0b-4f2c-ad2e-437d4e7781b4 None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.058722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8819d3-ec0b-4f2c-ad2e-437d4e7781b4 None admin] RBAC: Authorizing `identity:get_project(project_id=6e64bcb074d64c2bb6c792b4dbabaa20)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:23.060853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8819d3-ec0b-4f2c-ad2e-437d4e7781b4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:23.062761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 545/1071] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:22 2022] GET /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:23.068838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:23.069440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1212d-f704-44db-b9b8-bae7ada89849 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.069735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1212d-f704-44db-b9b8-bae7ada89849 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.070021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1212d-f704-44db-b9b8-bae7ada89849 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.071392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 546/1072] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:23.077078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c555a5-b917-4ea1-ad0a-73a5ca9d92d2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.077366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c555a5-b917-4ea1-ad0a-73a5ca9d92d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.077650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c555a5-b917-4ea1-ad0a-73a5ca9d92d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.095360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f5c555a5-b917-4ea1-ad0a-73a5ca9d92d2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:23.096543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5c555a5-b917-4ea1-ad0a-73a5ca9d92d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:23.142855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:23.173160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 547/1073] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:23.174308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4042f75b-02e2-4983-ae44-16c09c7f4228 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:23.196450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c555a5-b917-4ea1-ad0a-73a5ca9d92d2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:23.214070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:23.214741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.215030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.215356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.216752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20, user.id=770a24c3ac934a21842aed35675ed088) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:23.217096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:23.218548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:23.233024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 527/1074] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:23 2022] GET /identity/v3/role_assignments?user.id=770a24c3ac934a21842aed35675ed088&scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:23.325654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c555a5-b917-4ea1-ad0a-73a5ca9d92d2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:23.364727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:23.365597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.365886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.366166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.378892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:23.388122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:23.389474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:23.390361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 548/1075] 10.222.0.27 () {56 vars in 1120 bytes} [Mon Jul 18 06:05:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:23.395502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:23.444826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:23.502406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e4f72-7b7f-4720-b43a-194550be5e8f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:23.539570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:23.540246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.540527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.540800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.541587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:23.541893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:23.543255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:23.557282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 528/1076] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 18 06:05:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:23.558459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:23.597277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:23.667371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc895d-d7b8-471a-84b0-3dc24fc48fe9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:23.709551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:23.710350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.710628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.710954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.722841 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:23.724293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:23.743563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:23.744586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:23.746265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:23.746265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:23.746265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:23.746265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:23.746265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 549/1077] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:23.750974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:23.864344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81115c41-ddbf-423a-b2c9-143d9c7a19db None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:23.875392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:23.911886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:23.912574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:23.912858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:23.913162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:23.914007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:23.914311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:23.915706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:23.931516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 529/1078] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:23.936571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:24.026771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:24.045057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056dcdf4-e4b7-4653-85b0-c6ba473d6c79 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:24.099520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:24.100316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:24.100602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:24.100881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:24.109123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:24.110568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:05:24.125455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:24.126438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:24.128000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 550/1079] 10.222.0.27 () {56 vars in 1093 bytes} [Mon Jul 18 06:05:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:24.132202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:24.245512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff9454a-541a-4edd-94a2-0759bac59836 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:24.283956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3aa1ea-be85-42d0-8f95-a67693edfb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:24.284627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa1ea-be85-42d0-8f95-a67693edfb9c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:24.284911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa1ea-be85-42d0-8f95-a67693edfb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:24.285218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3aa1ea-be85-42d0-8f95-a67693edfb9c None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:24.286091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aa1ea-be85-42d0-8f95-a67693edfb9c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:24.286402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aa1ea-be85-42d0-8f95-a67693edfb9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:24.287873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3aa1ea-be85-42d0-8f95-a67693edfb9c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:24.310358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 530/1080] 10.222.0.27 () {56 vars in 1133 bytes} [Mon Jul 18 06:05:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:24.316405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:24.436649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d431600-a7d6-451c-a07b-4eb9e2251aaa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:24.439640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642bc1-27d1-4ef7-a788-0e8853e77458 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:24.440107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642bc1-27d1-4ef7-a788-0e8853e77458 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:24.440216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20642bc1-27d1-4ef7-a788-0e8853e77458 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:24.441633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 531/1081] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:24.447439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd80e93-b015-4f18-b595-022a9c4bea30 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:24.447729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd80e93-b015-4f18-b595-022a9c4bea30 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:24.448018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd80e93-b015-4f18-b595-022a9c4bea30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:24.466367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bcd80e93-b015-4f18-b595-022a9c4bea30 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:24.467678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bcd80e93-b015-4f18-b595-022a9c4bea30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:24.483876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:24.484641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:24.484928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:24.485223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:24.491039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:24.504904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:24.552767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 532/1082] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:24.576388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd80e93-b015-4f18-b595-022a9c4bea30 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:24.579493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:24.581439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:24.713664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 551/1083] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:05:24.719155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:24.721676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd80e93-b015-4f18-b595-022a9c4bea30 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:24.767988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:24.768629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:24.768908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:24.769216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:24.774262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:24.798448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:24.841031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084b0f2-079d-43d6-91fb-6575b81c3b7f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:24.852659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:24.854158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:24.881674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:24.884181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:24.884181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:24.884181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:24.896794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:24.898273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:24.923503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:24.924479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:24.925388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:24.925388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:24.925388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:24.925388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:24.925388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 552/1084] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:24.930824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:24.991344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 533/1085] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 06:05:24.994301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:25.045908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:25.050368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c048e-1b19-49b7-b037-f67d0aea2147 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:25.058421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:25.094639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:25.095313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.095599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.095883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.096617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:25.096925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:25.098341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:25.110422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 553/1086] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:25.112088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d0615-c8e2-4922-9aca-306ea074151a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:25.119049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:25.162745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:25.163812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.164613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.164613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.180956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:25.185262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:05:25.214420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:25.215503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:25.216684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:05:25.216684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:05:25.216684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:05:25.216684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:25.216684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 534/1087] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:25.226372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:25.274747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b9790-4255-4a96-95d3-fa39e5782b61 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:25.326412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee95831-4bd4-4e8e-a416-3a8d51ba3bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:25.327221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95831-4bd4-4e8e-a416-3a8d51ba3bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.327506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95831-4bd4-4e8e-a416-3a8d51ba3bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.327781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee95831-4bd4-4e8e-a416-3a8d51ba3bd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.335291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee95831-4bd4-4e8e-a416-3a8d51ba3bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:25.336767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee95831-4bd4-4e8e-a416-3a8d51ba3bd5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2ee95831-4bd4-4e8e-a416-3a8d51ba3bd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:05:25.352108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:25.353315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:25.354245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 554/1088] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:05:25.355079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3cbf2-960b-4e60-966b-afee66801c28 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.355372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3cbf2-960b-4e60-966b-afee66801c28 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.355652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3cbf2-960b-4e60-966b-afee66801c28 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.357635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 555/1089] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:25.360962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3cbf2-960b-4e60-966b-afee66801c28 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:25.365728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8f9c5a-bbe7-4793-98bb-fcaafeec1ed7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:25.377271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:25.384813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:25.404600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aeaf5f-874b-4772-a4df-f96953024b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:25.405333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeaf5f-874b-4772-a4df-f96953024b58 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.405612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeaf5f-874b-4772-a4df-f96953024b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.405892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aeaf5f-874b-4772-a4df-f96953024b58 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.406640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeaf5f-874b-4772-a4df-f96953024b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:25.406953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeaf5f-874b-4772-a4df-f96953024b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:25.408371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aeaf5f-874b-4772-a4df-f96953024b58 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:25.433416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 535/1090] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:25.433416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802c10b-4d07-4326-b2f7-5aede32e8495 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.433416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802c10b-4d07-4326-b2f7-5aede32e8495 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.433416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802c10b-4d07-4326-b2f7-5aede32e8495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.460567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3802c10b-4d07-4326-b2f7-5aede32e8495 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:25.462720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3802c10b-4d07-4326-b2f7-5aede32e8495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:25.498984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3cbf2-960b-4e60-966b-afee66801c28 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:25.560549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:25.561653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.562128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.562651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.569413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:25.569685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 536/1091] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:25.569839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:25.569839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:25.585527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 556/1092] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:25.592725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802c10b-4d07-4326-b2f7-5aede32e8495 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:25.605372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:25.722563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:25.751329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ca741-8b71-43f4-87a8-b1c8368e701c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:25.753347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:25.760071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802c10b-4d07-4326-b2f7-5aede32e8495 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:25.803307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:25.804811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.805316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.805783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.822662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:25.823584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:25.824052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:25.824506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:25.825332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:25.826569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] RBAC: Adding query filter params (role.id=b78180a039814a8d8f4264db49c54be5, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=065014e1d5984a3db142381ccc62a420) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:25.827085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:25.829694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:25.839209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:25.841315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:25.843181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:25.844439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 537/1093] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:25 2022] GET /identity/v3/role_assignments?user.id=065014e1d5984a3db142381ccc62a420&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=b78180a039814a8d8f4264db49c54be5 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:25.845081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 557/1094] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:25.851970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:25.980435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b990d-04aa-4e77-a68f-900ecf45171b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:26.024832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:26.025661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:26.026052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:26.026424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:26.027638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:26.028703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:26.030696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:26.042514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 538/1095] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:26.049728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:26.182822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c39256-0616-45a4-8962-3dd49249c655 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:26.220145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:26.221056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:26.221347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:26.221629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] PATH_INFO: `/v3/users/770a24c3ac934a21842aed35675ed088` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:26.222947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] RBAC: Authorizing `identity:get_user(user_id=770a24c3ac934a21842aed35675ed088)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:26.224421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:26.226183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 558/1096] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:26 2022] GET /identity/v3/users/770a24c3ac934a21842aed35675ed088 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:26.233356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:26.265939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:26.372321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197c2bf-b5f8-4d86-8ccf-e9b2c6dad7d6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:26.432273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4717794-208f-44c6-85ed-303e217a60f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:26.433838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4717794-208f-44c6-85ed-303e217a60f1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:26.434790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4717794-208f-44c6-85ed-303e217a60f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:26.435275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4717794-208f-44c6-85ed-303e217a60f1 None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:26.437716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4717794-208f-44c6-85ed-303e217a60f1 None admin] RBAC: Authorizing `identity:get_project(project_id=6e64bcb074d64c2bb6c792b4dbabaa20)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:26.440439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4717794-208f-44c6-85ed-303e217a60f1 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:26.443762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 539/1097] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:26 2022] GET /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20 => generated 311 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:26.452929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:26.463972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:26.582117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cc538-8f70-44c4-9dbf-6effadf2b290 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:26.629569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd056c23-352d-4ff7-92f1-9ea087c011a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:26.630673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056c23-352d-4ff7-92f1-9ea087c011a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:26.631145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056c23-352d-4ff7-92f1-9ea087c011a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:26.631601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd056c23-352d-4ff7-92f1-9ea087c011a9 None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20/users/770a24c3ac934a21842aed35675ed088/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:26.633820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056c23-352d-4ff7-92f1-9ea087c011a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e64bcb074d64c2bb6c792b4dbabaa20, user_id=770a24c3ac934a21842aed35675ed088, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:26.635678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd056c23-352d-4ff7-92f1-9ea087c011a9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:26.713061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 559/1098] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:05:26 2022] PUT /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20/users/770a24c3ac934a21842aed35675ed088/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:05:28.784815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdd57-e4e8-4820-850c-6889c782a702 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:28.785527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdd57-e4e8-4820-850c-6889c782a702 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:28.785527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cdd57-e4e8-4820-850c-6889c782a702 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:28.787142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 540/1099] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:28.792567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a9c5-156e-4044-a5d7-73344bef8e7d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:28.793053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a9c5-156e-4044-a5d7-73344bef8e7d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:28.793166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635a9c5-156e-4044-a5d7-73344bef8e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:28.810913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f635a9c5-156e-4044-a5d7-73344bef8e7d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:28.812131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f635a9c5-156e-4044-a5d7-73344bef8e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:28.876628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:28.884316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 560/1100] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:28.909136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cdd57-e4e8-4820-850c-6889c782a702 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:29.007946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:29.017706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cdd57-e4e8-4820-850c-6889c782a702 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:29.064458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:29.065204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:29.065494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:29.065773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:29.076345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:29.083926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:29.085306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:29.086162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 541/1101] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:29.091443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a9c5-156e-4044-a5d7-73344bef8e7d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:29.194574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635a9c5-156e-4044-a5d7-73344bef8e7d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:29.229325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:29.229994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:29.230272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:29.230549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:29.232135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:29.232611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:29.234023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:29.242511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 561/1102] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:29.249654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:29.365026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be3756-2791-4d6a-bdeb-3d4d135b9076 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:29.399750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:29.400611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:29.400897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:29.401196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] PATH_INFO: `/v3/users/770a24c3ac934a21842aed35675ed088` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:29.402385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] RBAC: Authorizing `identity:get_user(user_id=770a24c3ac934a21842aed35675ed088)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:29.404039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:29.405734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 542/1103] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:29 2022] GET /identity/v3/users/770a24c3ac934a21842aed35675ed088 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:29.411593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:29.471652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:29.516354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90563e8-41ce-4000-837e-813c8915c668 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:29.550612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:29.551256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:29.551541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:29.551817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:29.627751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:29.629454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:29.702831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:29.756842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 562/1104] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 06:05:29.766338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:29.791941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:29.880244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d02f46-abf4-4802-9f11-646854c5bb4d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:29.915919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836c646c-64c1-4dc5-9d3f-64b1074c8827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:29.916860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c646c-64c1-4dc5-9d3f-64b1074c8827 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:29.917168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c646c-64c1-4dc5-9d3f-64b1074c8827 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:29.917446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836c646c-64c1-4dc5-9d3f-64b1074c8827 None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:29.919408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c646c-64c1-4dc5-9d3f-64b1074c8827 None admin] RBAC: Authorizing `identity:get_project(project_id=6e64bcb074d64c2bb6c792b4dbabaa20)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:29.920869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836c646c-64c1-4dc5-9d3f-64b1074c8827 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:29.922734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 543/1105] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:29 2022] GET /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:29.929419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:30.042159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dac6da-d329-4421-9f87-1cd4a001ecee None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:30.080624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2a807-ea71-4b6f-a5f4-d1d7b428d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:30.081312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a807-ea71-4b6f-a5f4-d1d7b428d33a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:30.081594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a807-ea71-4b6f-a5f4-d1d7b428d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:30.081866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2a807-ea71-4b6f-a5f4-d1d7b428d33a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:30.082707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a807-ea71-4b6f-a5f4-d1d7b428d33a None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20, user.id=770a24c3ac934a21842aed35675ed088) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:30.083015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a807-ea71-4b6f-a5f4-d1d7b428d33a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:30.084480 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2a807-ea71-4b6f-a5f4-d1d7b428d33a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:30.092063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 563/1106] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:29 2022] GET /identity/v3/role_assignments?user.id=770a24c3ac934a21842aed35675ed088&scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:32.940401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e06df-45ed-4744-be86-dbb84ef36612 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:32.941036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e06df-45ed-4744-be86-dbb84ef36612 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:32.941036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e06df-45ed-4744-be86-dbb84ef36612 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:32.942385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 544/1107] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:32.947987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826c5c7-4bc0-4a1f-addc-4ac3959bb203 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:32.948473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826c5c7-4bc0-4a1f-addc-4ac3959bb203 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:32.948613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826c5c7-4bc0-4a1f-addc-4ac3959bb203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:32.966253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4826c5c7-4bc0-4a1f-addc-4ac3959bb203 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:32.967538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4826c5c7-4bc0-4a1f-addc-4ac3959bb203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:32.987148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:33.042751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 564/1108] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:33.069104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e06df-45ed-4744-be86-dbb84ef36612 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:33.165005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:33.179807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e06df-45ed-4744-be86-dbb84ef36612 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:33.219724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17090589-5308-4f9d-a9c0-0062e12c837a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:33.220436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17090589-5308-4f9d-a9c0-0062e12c837a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:33.220720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17090589-5308-4f9d-a9c0-0062e12c837a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:33.221025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17090589-5308-4f9d-a9c0-0062e12c837a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:33.222227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17090589-5308-4f9d-a9c0-0062e12c837a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:33.223674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17090589-5308-4f9d-a9c0-0062e12c837a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:33.225442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 545/1109] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:33.232409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826c5c7-4bc0-4a1f-addc-4ac3959bb203 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:33.343449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826c5c7-4bc0-4a1f-addc-4ac3959bb203 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:33.380944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc73c97-9c94-40db-b886-71e411cb2efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:33.381640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc73c97-9c94-40db-b886-71e411cb2efe None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:33.381923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc73c97-9c94-40db-b886-71e411cb2efe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:33.382193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc73c97-9c94-40db-b886-71e411cb2efe None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:33.382923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc73c97-9c94-40db-b886-71e411cb2efe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:33.384352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc73c97-9c94-40db-b886-71e411cb2efe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:33.467975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 565/1110] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:05:33 2022] POST /identity/v3/users => generated 286 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:05:35.641797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432ed74-ebca-4275-8e2c-33d60dc626fc None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:35.642369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432ed74-ebca-4275-8e2c-33d60dc626fc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:35.642493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432ed74-ebca-4275-8e2c-33d60dc626fc None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:35.643925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 546/1111] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:35.649758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847566-4408-43df-8415-eb19a4dea008 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:35.650529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847566-4408-43df-8415-eb19a4dea008 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:35.650529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847566-4408-43df-8415-eb19a4dea008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:35.668156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b5847566-4408-43df-8415-eb19a4dea008 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:35.670782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b5847566-4408-43df-8415-eb19a4dea008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:35.673120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:35.743267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 566/1112] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:35.767961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432ed74-ebca-4275-8e2c-33d60dc626fc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:35.883752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432ed74-ebca-4275-8e2c-33d60dc626fc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:35.920845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:35.921741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:35.922026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:35.922303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] PATH_INFO: `/v3/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:35.923867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] RBAC: Authorizing `identity:get_role(role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:35.925294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:35.926727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 547/1113] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:35 2022] GET /identity/v3/roles/e5e16600844f49db892c00085568f6e8 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:35.933267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847566-4408-43df-8415-eb19a4dea008 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:36.048321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847566-4408-43df-8415-eb19a4dea008 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:36.085961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:36.086868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:36.087157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:36.087438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] PATH_INFO: `/v3/users/ae0af606285b4d49be9c30c512fba9bf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:36.097122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:36.105532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0af606285b4d49be9c30c512fba9bf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:36.107869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:36.109798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 567/1114] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:35 2022] GET /identity/v3/users/ae0af606285b4d49be9c30c512fba9bf => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:36.116254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:36.144511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:36.229426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb36b-bc53-44fb-af83-fc89ca6e9abc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:36.282662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:36.283730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:36.284226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:36.284748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:36.373693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:36.375165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:36.405001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:36.485841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 548/1115] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 06:05:36.495513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:36.672424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639dae21-8554-48a6-a239-042ffbc11c93 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:36.731775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f58c353-3872-452d-9619-4274b322702c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:36.733348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c353-3872-452d-9619-4274b322702c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:36.733869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c353-3872-452d-9619-4274b322702c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:36.734377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f58c353-3872-452d-9619-4274b322702c None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:36.736672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58c353-3872-452d-9619-4274b322702c None admin] RBAC: Authorizing `identity:get_project(project_id=6e64bcb074d64c2bb6c792b4dbabaa20)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:36.739038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f58c353-3872-452d-9619-4274b322702c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:36.741909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 568/1116] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:36 2022] GET /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20 => generated 311 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:36.753326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:36.939933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975aada7-b25d-42e2-9093-69af7a05c98c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:36.971761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:36.984458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544430e-9705-4a68-abd7-f4e97ab66ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:36.985319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544430e-9705-4a68-abd7-f4e97ab66ac8 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:36.985692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544430e-9705-4a68-abd7-f4e97ab66ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:36.986059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544430e-9705-4a68-abd7-f4e97ab66ac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:36.987108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544430e-9705-4a68-abd7-f4e97ab66ac8 None admin] RBAC: Adding query filter params (role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20, user.id=ae0af606285b4d49be9c30c512fba9bf) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:36.987467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544430e-9705-4a68-abd7-f4e97ab66ac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:36.989087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544430e-9705-4a68-abd7-f4e97ab66ac8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:36.995678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 549/1117] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:36 2022] GET /identity/v3/role_assignments?user.id=ae0af606285b4d49be9c30c512fba9bf&scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20&role.id=e5e16600844f49db892c00085568f6e8 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:39.057962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938342-15f5-4fea-ae71-27ebc8462f73 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:39.058607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938342-15f5-4fea-ae71-27ebc8462f73 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:39.058607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb938342-15f5-4fea-ae71-27ebc8462f73 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:39.060883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 569/1118] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:39.067071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c3c0-a877-4d5d-80c4-846e13ec9298 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:39.067682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c3c0-a877-4d5d-80c4-846e13ec9298 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:39.067682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59c3c0-a877-4d5d-80c4-846e13ec9298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:39.086165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9b59c3c0-a877-4d5d-80c4-846e13ec9298 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:39.087400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9b59c3c0-a877-4d5d-80c4-846e13ec9298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:39.197663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 550/1119] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:39.225408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb938342-15f5-4fea-ae71-27ebc8462f73 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:39.330711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:39.378511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb938342-15f5-4fea-ae71-27ebc8462f73 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:39.418266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:39.419235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:39.419438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:39.419673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] PATH_INFO: `/v3/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:39.421316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] RBAC: Authorizing `identity:get_role(role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:39.422729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:39.424246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 570/1120] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:39 2022] GET /identity/v3/roles/e5e16600844f49db892c00085568f6e8 => generated 223 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:39.430879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c3c0-a877-4d5d-80c4-846e13ec9298 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:39.548476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59c3c0-a877-4d5d-80c4-846e13ec9298 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:39.569599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:39.598535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:39.600051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:39.600547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:39.601087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] PATH_INFO: `/v3/users/ae0af606285b4d49be9c30c512fba9bf` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:39.603293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] RBAC: Authorizing `identity:get_user(user_id=ae0af606285b4d49be9c30c512fba9bf)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:39.606469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:39.609606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 551/1121] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:39 2022] GET /identity/v3/users/ae0af606285b4d49be9c30c512fba9bf => generated 286 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:39.616034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:39.733620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d767ae-1e20-4cb8-8358-780e2a6aa9f5 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:39.766546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:39.772654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310075ab-9a4c-4c13-99c4-aa555b134e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:39.773626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310075ab-9a4c-4c13-99c4-aa555b134e1d None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:39.784653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310075ab-9a4c-4c13-99c4-aa555b134e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:39.784653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310075ab-9a4c-4c13-99c4-aa555b134e1d None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:39.784653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310075ab-9a4c-4c13-99c4-aa555b134e1d None admin] RBAC: Authorizing `identity:get_project(project_id=6e64bcb074d64c2bb6c792b4dbabaa20)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:39.784653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310075ab-9a4c-4c13-99c4-aa555b134e1d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:39.784653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 571/1122] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:39 2022] GET /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:39.785796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:39.901915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec9f49-9051-4b0d-9468-5f078bc97ec9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:39.940317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ad4fc-2716-488c-82c2-f07399433d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:39.941256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ad4fc-2716-488c-82c2-f07399433d0e None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:39.941544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ad4fc-2716-488c-82c2-f07399433d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:39.941828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ad4fc-2716-488c-82c2-f07399433d0e None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20/users/ae0af606285b4d49be9c30c512fba9bf/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:39.944184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ad4fc-2716-488c-82c2-f07399433d0e None admin] RBAC: Authorizing `identity:create_grant(project_id=6e64bcb074d64c2bb6c792b4dbabaa20, user_id=ae0af606285b4d49be9c30c512fba9bf, role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:39.945682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ad4fc-2716-488c-82c2-f07399433d0e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:40.020099 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 552/1123] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:05:39 2022] PUT /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20/users/ae0af606285b4d49be9c30c512fba9bf/roles/e5e16600844f49db892c00085568f6e8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:05:42.121987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713064-6610-470e-a255-9341f420e732 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:42.122765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713064-6610-470e-a255-9341f420e732 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:42.122765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b713064-6610-470e-a255-9341f420e732 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:42.123992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 572/1124] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:42.130068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ea45-2d95-4b43-b6b0-42369fe909f8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:42.130575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ea45-2d95-4b43-b6b0-42369fe909f8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:42.130701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3ea45-2d95-4b43-b6b0-42369fe909f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:42.148028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c8f3ea45-2d95-4b43-b6b0-42369fe909f8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:42.149263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c8f3ea45-2d95-4b43-b6b0-42369fe909f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:42.196602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:42.222734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 553/1125] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:42.247811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713064-6610-470e-a255-9341f420e732 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:42.366485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b713064-6610-470e-a255-9341f420e732 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:42.404098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:42.405146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:42.405514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:42.405874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] PATH_INFO: `/v3/roles/e5e16600844f49db892c00085568f6e8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:42.407546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] RBAC: Authorizing `identity:get_role(role_id=e5e16600844f49db892c00085568f6e8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:42.408928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:42.410411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 573/1126] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:42 2022] GET /identity/v3/roles/e5e16600844f49db892c00085568f6e8 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:42.417217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ea45-2d95-4b43-b6b0-42369fe909f8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:42.598631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3ea45-2d95-4b43-b6b0-42369fe909f8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:42.654572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:42.655395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:42.655683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:42.655965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] PATH_INFO: `/v3/users/ae0af606285b4d49be9c30c512fba9bf` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:42.657434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] RBAC: Authorizing `identity:get_user(user_id=ae0af606285b4d49be9c30c512fba9bf)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:42.658958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:42.660805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 554/1127] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:42 2022] GET /identity/v3/users/ae0af606285b4d49be9c30c512fba9bf => generated 286 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:42.666815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:42.751858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:42.810767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b054c-b32d-4f4f-b53a-12d47182f48b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:42.849305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:42.849974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:42.850259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:42.850534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:42.927059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:42.928416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:43.001317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:43.038603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 574/1128] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:05:43.049197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:43.131912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:43.231111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03ebc-b8ae-4b33-8fbf-70596e18b7ed None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:43.292473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad146182-8790-4001-9245-54bb992eac9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:43.293922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad146182-8790-4001-9245-54bb992eac9c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:43.294431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad146182-8790-4001-9245-54bb992eac9c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:43.294826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad146182-8790-4001-9245-54bb992eac9c None admin] PATH_INFO: `/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:43.297472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad146182-8790-4001-9245-54bb992eac9c None admin] RBAC: Authorizing `identity:get_project(project_id=6e64bcb074d64c2bb6c792b4dbabaa20)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:43.300189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad146182-8790-4001-9245-54bb992eac9c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:43.303456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 555/1129] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:43 2022] GET /identity/v3/projects/6e64bcb074d64c2bb6c792b4dbabaa20 => generated 311 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:43.310170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:43.418782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a961357-1f70-43a3-9fbf-f9298dc4a128 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:43.457443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66d0ac-1bec-4ab6-949e-3755b12c6ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:43.458097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d0ac-1bec-4ab6-949e-3755b12c6ebd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:43.458376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d0ac-1bec-4ab6-949e-3755b12c6ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:43.458645 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d0ac-1bec-4ab6-949e-3755b12c6ebd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:43.459477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66d0ac-1bec-4ab6-949e-3755b12c6ebd None admin] RBAC: Adding query filter params (role.id=e5e16600844f49db892c00085568f6e8, scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20, user.id=ae0af606285b4d49be9c30c512fba9bf) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:43.459788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66d0ac-1bec-4ab6-949e-3755b12c6ebd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:43.461245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66d0ac-1bec-4ab6-949e-3755b12c6ebd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:43.468559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 575/1130] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:43 2022] GET /identity/v3/role_assignments?user.id=ae0af606285b4d49be9c30c512fba9bf&scope.project.id=6e64bcb074d64c2bb6c792b4dbabaa20&role.id=e5e16600844f49db892c00085568f6e8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:45.604362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840222b-e9e7-45bf-bd9d-3e605da05e04 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:45.604901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840222b-e9e7-45bf-bd9d-3e605da05e04 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:45.604901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9840222b-e9e7-45bf-bd9d-3e605da05e04 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:45.607121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 556/1131] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:45.613026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe5ab-cd83-4667-a5b6-073ece3ca8a7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:45.613535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe5ab-cd83-4667-a5b6-073ece3ca8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:45.613658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befe5ab-cd83-4667-a5b6-073ece3ca8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:45.632752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2befe5ab-cd83-4667-a5b6-073ece3ca8a7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:45.634013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2befe5ab-cd83-4667-a5b6-073ece3ca8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:45.662904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:45.709323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 576/1132] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:45.735610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840222b-e9e7-45bf-bd9d-3e605da05e04 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:45.863369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9840222b-e9e7-45bf-bd9d-3e605da05e04 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:45.879296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:45.902028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f305ed57-91e5-4855-b87b-00796a64c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:45.903667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ed57-91e5-4855-b87b-00796a64c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:45.903949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ed57-91e5-4855-b87b-00796a64c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:45.904229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f305ed57-91e5-4855-b87b-00796a64c2f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:45.905536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305ed57-91e5-4855-b87b-00796a64c2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:45.906988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f305ed57-91e5-4855-b87b-00796a64c2f2 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:45.908670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 557/1133] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:45.918841 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befe5ab-cd83-4667-a5b6-073ece3ca8a7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:46.021425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befe5ab-cd83-4667-a5b6-073ece3ca8a7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:46.056290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34adec6-07c2-4799-b03e-7d011bd86afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:46.056948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34adec6-07c2-4799-b03e-7d011bd86afe None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:46.057269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34adec6-07c2-4799-b03e-7d011bd86afe None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:46.057551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34adec6-07c2-4799-b03e-7d011bd86afe None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:46.058261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34adec6-07c2-4799-b03e-7d011bd86afe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:46.059832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34adec6-07c2-4799-b03e-7d011bd86afe None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:46.143381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 577/1134] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:05:45 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:05:48.259320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107702e8-cf84-4342-8335-f902fff860ef None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:48.259879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107702e8-cf84-4342-8335-f902fff860ef None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:48.259879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107702e8-cf84-4342-8335-f902fff860ef None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:48.261337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 558/1135] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:48.268369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60c39-f263-4066-8b87-d72036b2ee8c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:48.268875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60c39-f263-4066-8b87-d72036b2ee8c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:48.269037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d60c39-f263-4066-8b87-d72036b2ee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:48.287050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-63d60c39-f263-4066-8b87-d72036b2ee8c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:48.288341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63d60c39-f263-4066-8b87-d72036b2ee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:48.300094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:48.363129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 578/1136] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:48.389647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107702e8-cf84-4342-8335-f902fff860ef None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:48.505373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107702e8-cf84-4342-8335-f902fff860ef None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:48.545061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fabe428-d7f2-4004-9b2d-e1fcd1b6d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:48.545833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe428-d7f2-4004-9b2d-e1fcd1b6d590 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:48.546166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe428-d7f2-4004-9b2d-e1fcd1b6d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:48.546490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fabe428-d7f2-4004-9b2d-e1fcd1b6d590 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:48.547863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabe428-d7f2-4004-9b2d-e1fcd1b6d590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:48.549475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fabe428-d7f2-4004-9b2d-e1fcd1b6d590 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:48.551294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 559/1137] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:05:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:48.558073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60c39-f263-4066-8b87-d72036b2ee8c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:48.670817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d60c39-f263-4066-8b87-d72036b2ee8c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:48.708351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d167f6a-467d-46b8-b0f9-e2776685f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:48.709067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167f6a-467d-46b8-b0f9-e2776685f4d6 None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:48.709355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167f6a-467d-46b8-b0f9-e2776685f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:48.709631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d167f6a-467d-46b8-b0f9-e2776685f4d6 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:48.710375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d167f6a-467d-46b8-b0f9-e2776685f4d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:48.711824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d167f6a-467d-46b8-b0f9-e2776685f4d6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:48.791305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:48.797264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 579/1138] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:05:48 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:05:50.926267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cc5fa-14c0-4299-8e33-2ae050703e07 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:50.926845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cc5fa-14c0-4299-8e33-2ae050703e07 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:50.926845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cc5fa-14c0-4299-8e33-2ae050703e07 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:50.928675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 560/1139] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:05:50.937941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6286c-89fc-4400-b89a-81c641790437 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:50.938707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6286c-89fc-4400-b89a-81c641790437 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:50.938707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6286c-89fc-4400-b89a-81c641790437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:50.956416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e9c6286c-89fc-4400-b89a-81c641790437 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:50.957654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e9c6286c-89fc-4400-b89a-81c641790437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:51.036842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 580/1140] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:05:51.061645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cc5fa-14c0-4299-8e33-2ae050703e07 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:51.120268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:51.188172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cc5fa-14c0-4299-8e33-2ae050703e07 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:51.251454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:51.252257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:51.252537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:51.252812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:51.264665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:51.272360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:51.274127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:51.275768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 561/1141] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:05:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:51.281807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6286c-89fc-4400-b89a-81c641790437 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:51.392706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6286c-89fc-4400-b89a-81c641790437 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:51.425274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:51.431555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:51.432230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:51.432513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:51.432782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:51.434067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:51.434378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:51.436236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:51.445891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 581/1142] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:05:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:51.453718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:51.569571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4ed3-22e1-43ad-bb3d-ce8a35f24367 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:51.580474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:51.607607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:51.608503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:51.608794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:51.609117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] PATH_INFO: `/v3/users/ee0e52d439914c3995e5ba61e53c7a2f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:51.626168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] RBAC: Authorizing `identity:get_user(user_id=ee0e52d439914c3995e5ba61e53c7a2f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:51.627706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:51.629861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 562/1143] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:51 2022] GET /identity/v3/users/ee0e52d439914c3995e5ba61e53c7a2f => generated 286 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:51.635976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:51.749804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d955ef-0f8c-4b45-b0ae-2a06434d5a64 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:51.785599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:51.786248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:51.786530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:51.786803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:51.853101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:51.864005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:51.865503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:51.978971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 582/1144] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:05:51.988081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:52.101750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88209b3b-d54f-40e8-944c-4b5a735e3eea None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:52.143150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65c0c1-de13-4b5b-be1a-44a00638cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:52.144026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c0c1-de13-4b5b-be1a-44a00638cd72 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:52.144308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c0c1-de13-4b5b-be1a-44a00638cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:52.144582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65c0c1-de13-4b5b-be1a-44a00638cd72 None admin] PATH_INFO: `/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:52.146013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65c0c1-de13-4b5b-be1a-44a00638cd72 None admin] RBAC: Authorizing `identity:get_project(project_id=fdc2d7bb18524cdf9934dd2e90b878bf)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:52.147508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65c0c1-de13-4b5b-be1a-44a00638cd72 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:52.149431 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 563/1145] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:51 2022] GET /identity/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:52.159659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:52.263340 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:52.271920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f7110-733d-4714-9561-155bdfeb1417 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:52.308191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016fefb-7c2c-44f8-95cf-86660e232a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:52.309580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016fefb-7c2c-44f8-95cf-86660e232a78 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:52.310351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016fefb-7c2c-44f8-95cf-86660e232a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:52.310351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016fefb-7c2c-44f8-95cf-86660e232a78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:52.311078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016fefb-7c2c-44f8-95cf-86660e232a78 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=fdc2d7bb18524cdf9934dd2e90b878bf, user.id=ee0e52d439914c3995e5ba61e53c7a2f) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:52.311429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016fefb-7c2c-44f8-95cf-86660e232a78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:52.312916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016fefb-7c2c-44f8-95cf-86660e232a78 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:52.319831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 583/1146] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:52 2022] GET /identity/v3/role_assignments?user.id=ee0e52d439914c3995e5ba61e53c7a2f&scope.project.id=fdc2d7bb18524cdf9934dd2e90b878bf&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:54.796607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0f4e-10de-4dbe-8fb5-036e475ca973 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:54.797279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0f4e-10de-4dbe-8fb5-036e475ca973 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:54.797279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e0f4e-10de-4dbe-8fb5-036e475ca973 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:54.798567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 564/1147] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:54.804606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9489b1-1473-4e0f-9d5e-d6454f280445 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:54.805161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9489b1-1473-4e0f-9d5e-d6454f280445 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:54.805260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9489b1-1473-4e0f-9d5e-d6454f280445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:54.823650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9d9489b1-1473-4e0f-9d5e-d6454f280445 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:54.824949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d9489b1-1473-4e0f-9d5e-d6454f280445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:54.910947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 584/1148] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:54.935072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0f4e-10de-4dbe-8fb5-036e475ca973 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:54.985540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:55.062456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e0f4e-10de-4dbe-8fb5-036e475ca973 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:55.100682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:55.101583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:55.101919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:55.102245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:55.115081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:55.123828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:55.126077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:05:55.127814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 565/1149] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:05:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:55.132606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9489b1-1473-4e0f-9d5e-d6454f280445 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:55.265013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:55.282871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9489b1-1473-4e0f-9d5e-d6454f280445 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:55.336689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:55.337758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:55.338263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:55.338760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:55.340180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:55.340897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:55.343466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:55.359998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 585/1150] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:05:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:55.366303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:55.479101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:55.487490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f02b4-a839-4b05-886f-69ec3cfe270b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:55.529466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:55.530487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:55.530824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:55.531167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] PATH_INFO: `/v3/users/ee0e52d439914c3995e5ba61e53c7a2f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:55.532645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] RBAC: Authorizing `identity:get_user(user_id=ee0e52d439914c3995e5ba61e53c7a2f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:55.534274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:55.536125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 566/1151] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:55 2022] GET /identity/v3/users/ee0e52d439914c3995e5ba61e53c7a2f => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:55.542283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:55.666546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc02bf-23d1-4001-be0c-d6c6173b2fc2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:55.708934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b6332-30e0-4381-bdad-9cc6db38eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:55.709918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6332-30e0-4381-bdad-9cc6db38eec8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:55.710385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6332-30e0-4381-bdad-9cc6db38eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:55.710795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b6332-30e0-4381-bdad-9cc6db38eec8 None admin] PATH_INFO: `/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:55.712281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b6332-30e0-4381-bdad-9cc6db38eec8 None admin] RBAC: Authorizing `identity:get_project(project_id=fdc2d7bb18524cdf9934dd2e90b878bf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:55.714048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b6332-30e0-4381-bdad-9cc6db38eec8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:55.716589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 586/1152] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:55 2022] GET /identity/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:05:55.724906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:55.865877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953d157-1881-438c-9e85-f49938e8deaf None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:55.906533 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ffc63-d123-4c35-bef6-d9a28e92c72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:55.907425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ffc63-d123-4c35-bef6-d9a28e92c72d None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:55.907708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ffc63-d123-4c35-bef6-d9a28e92c72d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:55.907984 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ffc63-d123-4c35-bef6-d9a28e92c72d None admin] PATH_INFO: `/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf/users/ee0e52d439914c3995e5ba61e53c7a2f/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:55.910093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ffc63-d123-4c35-bef6-d9a28e92c72d None admin] RBAC: Authorizing `identity:create_grant(project_id=fdc2d7bb18524cdf9934dd2e90b878bf, user_id=ee0e52d439914c3995e5ba61e53c7a2f, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:55.911531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ffc63-d123-4c35-bef6-d9a28e92c72d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:56.005758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 567/1153] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:05:55 2022] PUT /identity/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf/users/ee0e52d439914c3995e5ba61e53c7a2f/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:05:58.158571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3d055-c511-4b92-b7e4-e95ab081f0b8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:58.159204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3d055-c511-4b92-b7e4-e95ab081f0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:58.159204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3d055-c511-4b92-b7e4-e95ab081f0b8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:58.160591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 587/1154] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:05:58.169189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3485-4215-4780-bfa2-d4b95a1e9176 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:58.169765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3485-4215-4780-bfa2-d4b95a1e9176 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:58.170036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd3485-4215-4780-bfa2-d4b95a1e9176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:58.191669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-09fd3485-4215-4780-bfa2-d4b95a1e9176 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:05:58.192925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-09fd3485-4215-4780-bfa2-d4b95a1e9176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:05:58.214222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:58.275577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 568/1155] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:05:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:05:58.301587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3d055-c511-4b92-b7e4-e95ab081f0b8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:58.329018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:58.426154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3d055-c511-4b92-b7e4-e95ab081f0b8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:58.467419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:58.468245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:58.468531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:58.468807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:58.481882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:05:58.489829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:05:58.491626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:05:58.493206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 588/1156] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:05:58.499113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3485-4215-4780-bfa2-d4b95a1e9176 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:58.611954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd3485-4215-4780-bfa2-d4b95a1e9176 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:58.649243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:58.650057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:58.650437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:58.650805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:58.651668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:58.652073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:58.654339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:58.663596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 569/1157] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:58.670050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:58.758859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:58.783571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8047bb8-0472-40a7-8463-a55d9545ef60 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:58.822980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:58.824007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:58.824852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:58.825263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] PATH_INFO: `/v3/users/ee0e52d439914c3995e5ba61e53c7a2f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:58.826674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] RBAC: Authorizing `identity:get_user(user_id=ee0e52d439914c3995e5ba61e53c7a2f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:58.828207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:58.829930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 589/1158] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:05:58 2022] GET /identity/v3/users/ee0e52d439914c3995e5ba61e53c7a2f => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:58.835911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:58.854021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:58.969644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be563e76-4aee-484a-b70d-628b88ad03d9 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:59.007282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:59.007998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:59.008324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:59.008662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:59.086093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:59.087496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:59.104655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:59.202096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 570/1159] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:05:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:05:59.208163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:59.323998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4ab34c-33dd-46eb-bba6-b61452908d90 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:59.359533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e668523-eba4-4823-bf45-62dbbedcc5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:59.360309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668523-eba4-4823-bf45-62dbbedcc5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:59.360594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668523-eba4-4823-bf45-62dbbedcc5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:59.360878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e668523-eba4-4823-bf45-62dbbedcc5c1 None admin] PATH_INFO: `/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:59.362102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668523-eba4-4823-bf45-62dbbedcc5c1 None admin] RBAC: Authorizing `identity:get_project(project_id=fdc2d7bb18524cdf9934dd2e90b878bf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:59.363618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e668523-eba4-4823-bf45-62dbbedcc5c1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:59.365407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 590/1160] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:05:59 2022] GET /identity/v3/projects/fdc2d7bb18524cdf9934dd2e90b878bf => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:05:59.373747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:05:59.496093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30910f46-4556-4dbc-91b7-d106abff8aee None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:05:59.514153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:05:59.539632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ba25f-b8cc-4a99-a7c9-fce80bac3c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:05:59.540324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba25f-b8cc-4a99-a7c9-fce80bac3c77 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:05:59.540610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba25f-b8cc-4a99-a7c9-fce80bac3c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:05:59.540890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ba25f-b8cc-4a99-a7c9-fce80bac3c77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:05:59.541813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ba25f-b8cc-4a99-a7c9-fce80bac3c77 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=fdc2d7bb18524cdf9934dd2e90b878bf, user.id=ee0e52d439914c3995e5ba61e53c7a2f) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:05:59.542257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ba25f-b8cc-4a99-a7c9-fce80bac3c77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:05:59.544182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ba25f-b8cc-4a99-a7c9-fce80bac3c77 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:05:59.552433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 571/1161] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:05:59 2022] GET /identity/v3/role_assignments?user.id=ee0e52d439914c3995e5ba61e53c7a2f&scope.project.id=fdc2d7bb18524cdf9934dd2e90b878bf&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:01.681662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004fa0-ce3e-4d00-99ff-63649f998b9d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:01.682233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004fa0-ce3e-4d00-99ff-63649f998b9d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:01.682233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47004fa0-ce3e-4d00-99ff-63649f998b9d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:01.684173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 591/1162] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:06:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:06:01.690237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6100cd-9e98-4dfe-b8e7-bad619d95465 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:01.690744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6100cd-9e98-4dfe-b8e7-bad619d95465 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:01.690897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6100cd-9e98-4dfe-b8e7-bad619d95465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:01.709037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2f6100cd-9e98-4dfe-b8e7-bad619d95465 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:06:01.710262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2f6100cd-9e98-4dfe-b8e7-bad619d95465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:06:01.787869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 572/1163] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:06:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:06:01.812069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004fa0-ce3e-4d00-99ff-63649f998b9d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:01.830479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:01.928438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47004fa0-ce3e-4d00-99ff-63649f998b9d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:01.969891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:01.970527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:01.970815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:01.971091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:02.049396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:02.050879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:02.067837 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:02.165213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 592/1164] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:06:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 06:06:02.172967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6100cd-9e98-4dfe-b8e7-bad619d95465 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:02.281239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6100cd-9e98-4dfe-b8e7-bad619d95465 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:02.291558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:02.320832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a4f40-34e0-46c8-91a0-866a08714b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:02.321678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4f40-34e0-46c8-91a0-866a08714b2a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:02.321965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4f40-34e0-46c8-91a0-866a08714b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:02.322243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a4f40-34e0-46c8-91a0-866a08714b2a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:02.331083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a4f40-34e0-46c8-91a0-866a08714b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:02.332647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a4f40-34e0-46c8-91a0-866a08714b2a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-376a4f40-34e0-46c8-91a0-866a08714b2a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:06:02.349440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:06:02.351241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:06:02.352357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 573/1165] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:06:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:06:02.358797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:02.471413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2279637-31d9-4d69-9989-60d9c5dd1aeb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:02.486634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:02.509064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99432f-b7a8-4472-966a-944109f4f864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:02.509748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99432f-b7a8-4472-966a-944109f4f864 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:02.510033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99432f-b7a8-4472-966a-944109f4f864 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:02.510310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99432f-b7a8-4472-966a-944109f4f864 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:02.511051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99432f-b7a8-4472-966a-944109f4f864 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:06:02.511363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99432f-b7a8-4472-966a-944109f4f864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:02.513320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99432f-b7a8-4472-966a-944109f4f864 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:02.521615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 593/1166] 10.222.0.27 () {56 vars in 1115 bytes} [Mon Jul 18 06:06:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:04.624571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58088-b581-441d-b144-933c2bfb706c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:04.625154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58088-b581-441d-b144-933c2bfb706c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:04.625154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58088-b581-441d-b144-933c2bfb706c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:04.626572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 574/1167] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:06:04.632215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7458a-4f64-4511-94aa-d84e39047260 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:04.632755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7458a-4f64-4511-94aa-d84e39047260 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:04.632755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7458a-4f64-4511-94aa-d84e39047260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:04.651008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8cb7458a-4f64-4511-94aa-d84e39047260 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:06:04.652872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8cb7458a-4f64-4511-94aa-d84e39047260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:06:04.729485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 594/1168] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:06:04.753696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58088-b581-441d-b144-933c2bfb706c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:04.867929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58088-b581-441d-b144-933c2bfb706c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:04.912663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe6fd96-919b-4bca-ac82-f9c49f68bbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:04.913850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6fd96-919b-4bca-ac82-f9c49f68bbab None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:04.914346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6fd96-919b-4bca-ac82-f9c49f68bbab None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:04.914815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6fd96-919b-4bca-ac82-f9c49f68bbab None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:04.916266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6fd96-919b-4bca-ac82-f9c49f68bbab None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:04.919684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe6fd96-919b-4bca-ac82-f9c49f68bbab None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:04.991742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 575/1169] 10.222.0.27 () {60 vars in 1138 bytes} [Mon Jul 18 06:06:04 2022] POST /identity/v3/domains => generated 267 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:06:07.210481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d9a7-37c3-4379-9ccc-f4dd68f4cef7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:07.211036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d9a7-37c3-4379-9ccc-f4dd68f4cef7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:07.211036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578d9a7-37c3-4379-9ccc-f4dd68f4cef7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:07.212577 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 595/1170] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:06:07.219944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de1a05-eee4-4cee-a8cb-728e5e86cd78 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:07.220481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de1a05-eee4-4cee-a8cb-728e5e86cd78 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:07.220889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de1a05-eee4-4cee-a8cb-728e5e86cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:07.249656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-46de1a05-eee4-4cee-a8cb-728e5e86cd78 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:06:07.251662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-46de1a05-eee4-4cee-a8cb-728e5e86cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:06:07.294611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:07.364407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 576/1171] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:06:07.389217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d9a7-37c3-4379-9ccc-f4dd68f4cef7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:07.502334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578d9a7-37c3-4379-9ccc-f4dd68f4cef7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:07.510714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:07.540484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03704e-749f-4ad1-86fd-c22273b09530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:07.541415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03704e-749f-4ad1-86fd-c22273b09530 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:07.541699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03704e-749f-4ad1-86fd-c22273b09530 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:07.541973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03704e-749f-4ad1-86fd-c22273b09530 None admin] PATH_INFO: `/v3/domains/b7668004d0094ed4a2c5422a89bbfe9f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:07.555749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03704e-749f-4ad1-86fd-c22273b09530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b7668004d0094ed4a2c5422a89bbfe9f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:07.557335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03704e-749f-4ad1-86fd-c22273b09530 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:07.559889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 596/1172] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Jul 18 06:06:07 2022] GET /identity/v3/domains/b7668004d0094ed4a2c5422a89bbfe9f => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:07.566024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de1a05-eee4-4cee-a8cb-728e5e86cd78 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:07.731641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de1a05-eee4-4cee-a8cb-728e5e86cd78 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:07.791791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445214d1-0f00-4c14-8044-a02bbb1fe5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:07.793283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445214d1-0f00-4c14-8044-a02bbb1fe5c4 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:07.793803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445214d1-0f00-4c14-8044-a02bbb1fe5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:07.794298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445214d1-0f00-4c14-8044-a02bbb1fe5c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:07.795864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445214d1-0f00-4c14-8044-a02bbb1fe5c4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:07.798638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445214d1-0f00-4c14-8044-a02bbb1fe5c4 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:07.900738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 577/1173] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:06:07 2022] POST /identity/v3/projects => generated 361 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:06:10.045481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e51a-bec0-471c-9932-e41a667e765d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:10.046089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e51a-bec0-471c-9932-e41a667e765d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:10.046089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e51a-bec0-471c-9932-e41a667e765d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:10.047663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 597/1174] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:06:10.053792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b54a07-83a1-4829-9e6b-71446a4db473 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:10.054852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b54a07-83a1-4829-9e6b-71446a4db473 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:10.055034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b54a07-83a1-4829-9e6b-71446a4db473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:10.074466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b3b54a07-83a1-4829-9e6b-71446a4db473 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:06:10.075893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b3b54a07-83a1-4829-9e6b-71446a4db473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:06:10.079417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:10.149424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 578/1175] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:06:10.174580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2e51a-bec0-471c-9932-e41a667e765d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:10.287529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2e51a-bec0-471c-9932-e41a667e765d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:10.328522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803277e-c153-4024-848b-58db487b6951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:10.329562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803277e-c153-4024-848b-58db487b6951 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:10.329888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803277e-c153-4024-848b-58db487b6951 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:10.330205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803277e-c153-4024-848b-58db487b6951 None admin] PATH_INFO: `/v3/domains/b7668004d0094ed4a2c5422a89bbfe9f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:10.331505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803277e-c153-4024-848b-58db487b6951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b7668004d0094ed4a2c5422a89bbfe9f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:10.333034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d803277e-c153-4024-848b-58db487b6951 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:10.334766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 598/1176] 10.222.0.27 () {56 vars in 1183 bytes} [Mon Jul 18 06:06:10 2022] GET /identity/v3/domains/b7668004d0094ed4a2c5422a89bbfe9f => generated 267 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:06:10.340879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b54a07-83a1-4829-9e6b-71446a4db473 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:10.448198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b54a07-83a1-4829-9e6b-71446a4db473 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:10.485744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30b313-03d3-4f85-8bae-27ffe7661bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:10.486485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b313-03d3-4f85-8bae-27ffe7661bc8 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:10.486810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b313-03d3-4f85-8bae-27ffe7661bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:10.487131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30b313-03d3-4f85-8bae-27ffe7661bc8 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:10.487904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b313-03d3-4f85-8bae-27ffe7661bc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:10.489413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30b313-03d3-4f85-8bae-27ffe7661bc8 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:10.500672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:10.614120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 579/1177] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:06:10 2022] POST /identity/v3/users => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:06:12.770693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561d18-d059-4408-8a9a-b71970fe5e0c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:12.771248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561d18-d059-4408-8a9a-b71970fe5e0c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:12.771248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2561d18-d059-4408-8a9a-b71970fe5e0c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:12.772640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 599/1178] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:06:12.779146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334cfc-1ef9-4a76-8342-2d87333f0b89 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:12.779689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334cfc-1ef9-4a76-8342-2d87333f0b89 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:12.779689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd334cfc-1ef9-4a76-8342-2d87333f0b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:12.798513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bd334cfc-1ef9-4a76-8342-2d87333f0b89 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:06:12.799946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bd334cfc-1ef9-4a76-8342-2d87333f0b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:06:12.877763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 580/1179] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:06:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:06:12.901966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2561d18-d059-4408-8a9a-b71970fe5e0c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:12.942800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:13.020096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2561d18-d059-4408-8a9a-b71970fe5e0c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:13.062256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:13.062980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:13.063263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:13.063541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:13.075834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:06:13.083974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:06:13.085822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:06:13.087641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 600/1180] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:06:13.093823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334cfc-1ef9-4a76-8342-2d87333f0b89 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:13.209402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd334cfc-1ef9-4a76-8342-2d87333f0b89 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:13.239991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:13.250313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:13.251332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:13.251665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:13.251992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:13.252818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:06:13.253206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:13.254657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:13.264040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 581/1181] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:13.270316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:13.378192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:13.385639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02c2e7c-ef79-4280-90d5-24dca3b0de14 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:13.423648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:13.424537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:13.424820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:13.425128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] PATH_INFO: `/v3/users/7da318162b6f41c9a544c8c7e5f959f5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:13.441254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] RBAC: Authorizing `identity:get_user(user_id=7da318162b6f41c9a544c8c7e5f959f5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:13.442736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:13.444519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 601/1182] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:06:13 2022] GET /identity/v3/users/7da318162b6f41c9a544c8c7e5f959f5 => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:13.451248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:13.559813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859c9cd-f5c2-4bc5-921e-a66ab731cd32 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:13.597285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:13.597942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:13.598233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:13.598509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:13.659115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:13.677983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:13.680940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:13.859747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 582/1183] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:06:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:06:13.866455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:14.054616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a27de1-77c8-4a4d-83e1-37787e5b502b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:14.116056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cad580-e5a3-42c2-aa5c-47613b673d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:14.116933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad580-e5a3-42c2-aa5c-47613b673d2f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:14.117250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad580-e5a3-42c2-aa5c-47613b673d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:14.117530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cad580-e5a3-42c2-aa5c-47613b673d2f None admin] PATH_INFO: `/v3/projects/209a063d77e54c2db085b87036475746` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:14.118781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad580-e5a3-42c2-aa5c-47613b673d2f None admin] RBAC: Authorizing `identity:get_project(project_id=209a063d77e54c2db085b87036475746)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:14.120283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cad580-e5a3-42c2-aa5c-47613b673d2f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:14.122695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 602/1184] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:06:13 2022] GET /identity/v3/projects/209a063d77e54c2db085b87036475746 => generated 361 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:14.129214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:14.226729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:14.239921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd39e6-657c-4044-93ad-6c8877181dfc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:14.277760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6788ac2b-a23e-4449-876c-48c28be72779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:14.278604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788ac2b-a23e-4449-876c-48c28be72779 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:14.278868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788ac2b-a23e-4449-876c-48c28be72779 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:14.279169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6788ac2b-a23e-4449-876c-48c28be72779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:14.280011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788ac2b-a23e-4449-876c-48c28be72779 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=209a063d77e54c2db085b87036475746, user.id=7da318162b6f41c9a544c8c7e5f959f5) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:06:14.280381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788ac2b-a23e-4449-876c-48c28be72779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:14.281917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6788ac2b-a23e-4449-876c-48c28be72779 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:14.288138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 583/1185] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:06:14 2022] GET /identity/v3/role_assignments?user.id=7da318162b6f41c9a544c8c7e5f959f5&scope.project.id=209a063d77e54c2db085b87036475746&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:06:16.375166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9539-6c71-466d-92ee-f2a0980fdcef None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:16.375722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9539-6c71-466d-92ee-f2a0980fdcef None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:16.375722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9539-6c71-466d-92ee-f2a0980fdcef None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:16.377170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 603/1186] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:06:16.382795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6076e-81d2-4d7e-9e44-c98319e20f9e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:16.383271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6076e-81d2-4d7e-9e44-c98319e20f9e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:16.383361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf6076e-81d2-4d7e-9e44-c98319e20f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:16.401088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ddf6076e-81d2-4d7e-9e44-c98319e20f9e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:06:16.402988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ddf6076e-81d2-4d7e-9e44-c98319e20f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:06:16.474152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 584/1187] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:06:16.497687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9539-6c71-466d-92ee-f2a0980fdcef None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:16.520661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:16.606601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9539-6c71-466d-92ee-f2a0980fdcef None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:16.642905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:16.643692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:16.643976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:16.644250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:16.655627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:06:16.663323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:06:16.664448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:06:16.665567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:06:16.669251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 604/1188] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:06:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:06:16.671310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6076e-81d2-4d7e-9e44-c98319e20f9e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:16.755855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:16.774289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf6076e-81d2-4d7e-9e44-c98319e20f9e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:16.811966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:16.812644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:16.812929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:16.813241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:16.814001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:06:16.814311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:16.815884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:16.825088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 585/1189] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:06:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:16.831901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:16.916033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:16.936918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28894ad-e17e-43e9-a1e0-dcb5ad4080e2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:16.972903 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:16.973818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:16.974078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:16.974346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] PATH_INFO: `/v3/users/7da318162b6f41c9a544c8c7e5f959f5` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:16.975543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] RBAC: Authorizing `identity:get_user(user_id=7da318162b6f41c9a544c8c7e5f959f5)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:16.977027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:16.978652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 605/1190] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:06:16 2022] GET /identity/v3/users/7da318162b6f41c9a544c8c7e5f959f5 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:16.985434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:17.125510 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa72147-ebb7-4492-bdac-56f8dcbe7297 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:17.165416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528315b8-3d04-44fa-bdd8-7f932d480c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:17.166351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528315b8-3d04-44fa-bdd8-7f932d480c36 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:17.166574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528315b8-3d04-44fa-bdd8-7f932d480c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:17.166852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528315b8-3d04-44fa-bdd8-7f932d480c36 None admin] PATH_INFO: `/v3/projects/209a063d77e54c2db085b87036475746` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:17.168816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528315b8-3d04-44fa-bdd8-7f932d480c36 None admin] RBAC: Authorizing `identity:get_project(project_id=209a063d77e54c2db085b87036475746)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:17.170302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528315b8-3d04-44fa-bdd8-7f932d480c36 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:17.172113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 586/1191] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:06:16 2022] GET /identity/v3/projects/209a063d77e54c2db085b87036475746 => generated 361 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:17.178505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:17.286904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6f039-ce01-445d-a18f-e894ddb5dc6c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:17.324582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d524af-e2d7-4f37-9b87-bc8f5918c23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:17.325537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d524af-e2d7-4f37-9b87-bc8f5918c23d None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:17.325828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d524af-e2d7-4f37-9b87-bc8f5918c23d None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:17.326110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d524af-e2d7-4f37-9b87-bc8f5918c23d None admin] PATH_INFO: `/v3/projects/209a063d77e54c2db085b87036475746/users/7da318162b6f41c9a544c8c7e5f959f5/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:17.328338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d524af-e2d7-4f37-9b87-bc8f5918c23d None admin] RBAC: Authorizing `identity:create_grant(project_id=209a063d77e54c2db085b87036475746, user_id=7da318162b6f41c9a544c8c7e5f959f5, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:17.329881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d524af-e2d7-4f37-9b87-bc8f5918c23d None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:17.399284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 606/1192] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:06:17 2022] PUT /identity/v3/projects/209a063d77e54c2db085b87036475746/users/7da318162b6f41c9a544c8c7e5f959f5/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:06:19.444195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58fa84-e8c6-4b5e-a82b-1b4625208029 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:19.444788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58fa84-e8c6-4b5e-a82b-1b4625208029 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:19.444788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58fa84-e8c6-4b5e-a82b-1b4625208029 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:19.446169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 587/1193] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:06:19.451994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f07e1-3751-45f2-b23d-11fe6c2309e9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:19.452572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f07e1-3751-45f2-b23d-11fe6c2309e9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:19.452572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f07e1-3751-45f2-b23d-11fe6c2309e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:19.469850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b90f07e1-3751-45f2-b23d-11fe6c2309e9 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:06:19.471062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b90f07e1-3751-45f2-b23d-11fe6c2309e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:06:19.473291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:19.542384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 607/1194] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:06:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:06:19.567829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58fa84-e8c6-4b5e-a82b-1b4625208029 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:19.584506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:19.679066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58fa84-e8c6-4b5e-a82b-1b4625208029 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:19.716931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:19.717845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:19.718235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:19.718587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:19.731026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:06:19.738658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:06:19.741917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:06:19.742763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 588/1195] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:06:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:06:19.747039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f07e1-3751-45f2-b23d-11fe6c2309e9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:19.851163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f07e1-3751-45f2-b23d-11fe6c2309e9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:19.889517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:19.890264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:19.890595 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:19.890921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:19.891725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:06:19.892082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:19.893535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:19.899256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:19.903610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 608/1196] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:06:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:19.910307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:19.987673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:20.018061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba986de0-b6a8-4ca2-ab8d-b180a077d7ed None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:20.056204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:20.057147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:20.057434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:20.057713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] PATH_INFO: `/v3/users/7da318162b6f41c9a544c8c7e5f959f5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:20.059741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] RBAC: Authorizing `identity:get_user(user_id=7da318162b6f41c9a544c8c7e5f959f5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:20.061265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:20.063112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 589/1197] 10.222.0.27 () {56 vars in 1177 bytes} [Mon Jul 18 06:06:19 2022] GET /identity/v3/users/7da318162b6f41c9a544c8c7e5f959f5 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:06:20.069395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:20.177043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8adaf-aedd-4f43-a2e5-ce806925bb8a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:20.219058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:20.219793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:20.220117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:20.220438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:20.290221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:20.292915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:20.294565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:20.400067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 609/1198] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:06:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 06:06:20.406850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:20.517263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18db81bc-cb98-4b1d-9736-20fc4c2b9dfd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:20.553735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce549f-b71c-4abe-9d5b-9f32f14a0fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:20.554852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce549f-b71c-4abe-9d5b-9f32f14a0fdf None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:20.555133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce549f-b71c-4abe-9d5b-9f32f14a0fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:20.555407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce549f-b71c-4abe-9d5b-9f32f14a0fdf None admin] PATH_INFO: `/v3/projects/209a063d77e54c2db085b87036475746` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:20.556798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce549f-b71c-4abe-9d5b-9f32f14a0fdf None admin] RBAC: Authorizing `identity:get_project(project_id=209a063d77e54c2db085b87036475746)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:20.558854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce549f-b71c-4abe-9d5b-9f32f14a0fdf None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:20.561215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 590/1199] 10.222.0.27 () {56 vars in 1186 bytes} [Mon Jul 18 06:06:20 2022] GET /identity/v3/projects/209a063d77e54c2db085b87036475746 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:20.571068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:06:20.682455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:20.688862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb98c0-4a11-42c7-99e1-a59daa65bba9 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:06:20.727795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8197d-2aa8-462e-b8e9-6733d352a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:06:20.728504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8197d-2aa8-462e-b8e9-6733d352a496 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:06:20.728830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8197d-2aa8-462e-b8e9-6733d352a496 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:06:20.729188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8197d-2aa8-462e-b8e9-6733d352a496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:06:20.730696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8197d-2aa8-462e-b8e9-6733d352a496 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=209a063d77e54c2db085b87036475746, user.id=7da318162b6f41c9a544c8c7e5f959f5) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:06:20.731743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8197d-2aa8-462e-b8e9-6733d352a496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:06:20.733275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8197d-2aa8-462e-b8e9-6733d352a496 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:06:20.739775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 610/1200] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:06:20 2022] GET /identity/v3/role_assignments?user.id=7da318162b6f41c9a544c8c7e5f959f5&scope.project.id=209a063d77e54c2db085b87036475746&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:06:30.549262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:06:30.736804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=18 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:38.122970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1818b9-7935-4241-b1aa-7418f507971e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:38.123603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1818b9-7935-4241-b1aa-7418f507971e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:38.123603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1818b9-7935-4241-b1aa-7418f507971e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:38.124908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 591/1201] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:07:38.130445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e210a-e66d-4fa1-890e-3b12742fb745 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:38.130919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e210a-e66d-4fa1-890e-3b12742fb745 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:38.131165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3e210a-e66d-4fa1-890e-3b12742fb745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:38.149082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6a3e210a-e66d-4fa1-890e-3b12742fb745 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:07:38.150286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6a3e210a-e66d-4fa1-890e-3b12742fb745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:07:38.218860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 611/1202] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:07:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:07:38.243929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1818b9-7935-4241-b1aa-7418f507971e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:38.352601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1818b9-7935-4241-b1aa-7418f507971e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:38.388386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:38.389133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:38.389422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:38.389698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:38.401925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:38.403808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:38.424704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:38.429658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:38.432657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:38.432657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:38.432657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:38.432657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:38.432657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 592/1203] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:38.433243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e210a-e66d-4fa1-890e-3b12742fb745 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:38.536685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3e210a-e66d-4fa1-890e-3b12742fb745 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:38.567309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:38.573428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce996b21-ba04-4f1c-b891-3382b26a91f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:38.574231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce996b21-ba04-4f1c-b891-3382b26a91f6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:38.574649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce996b21-ba04-4f1c-b891-3382b26a91f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:38.575056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce996b21-ba04-4f1c-b891-3382b26a91f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:38.576031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce996b21-ba04-4f1c-b891-3382b26a91f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:38.576444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce996b21-ba04-4f1c-b891-3382b26a91f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:38.578018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce996b21-ba04-4f1c-b891-3382b26a91f6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:38.590368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 612/1204] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:38.596329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:38.651414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:38.698719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb3e9d-81b8-4a2f-a272-457efef6b2cc None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:38.734071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d732d-9d19-4958-9325-bf093dafd7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:38.734740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d732d-9d19-4958-9325-bf093dafd7cc None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:38.735022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d732d-9d19-4958-9325-bf093dafd7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:38.735297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d732d-9d19-4958-9325-bf093dafd7cc None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:38.736002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d732d-9d19-4958-9325-bf093dafd7cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:38.737463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d732d-9d19-4958-9325-bf093dafd7cc None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:38.896617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 593/1205] 10.222.0.27 () {60 vars in 1132 bytes} [Mon Jul 18 06:07:38 2022] POST /identity/v3/users => generated 251 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:07:41.066511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f99cb-2965-4b62-b52b-3ccd58edfdcd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:41.067091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f99cb-2965-4b62-b52b-3ccd58edfdcd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:41.067091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f99cb-2965-4b62-b52b-3ccd58edfdcd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:41.068446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 613/1206] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:07:41.075264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5a5d4-89f7-48a8-8967-3ae4a7ccb386 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:41.075780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5a5d4-89f7-48a8-8967-3ae4a7ccb386 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:41.075897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5a5d4-89f7-48a8-8967-3ae4a7ccb386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:41.094247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-24c5a5d4-89f7-48a8-8967-3ae4a7ccb386 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:07:41.095450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-24c5a5d4-89f7-48a8-8967-3ae4a7ccb386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:07:41.169973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 594/1207] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:07:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:07:41.195504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f99cb-2965-4b62-b52b-3ccd58edfdcd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:41.308653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f99cb-2965-4b62-b52b-3ccd58edfdcd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:41.343078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:41.343805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:41.344083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:41.344354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:41.355516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:07:41.363144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:41.364414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:41.365305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 614/1208] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:07:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:41.371792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5a5d4-89f7-48a8-8967-3ae4a7ccb386 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:41.414479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:41.477540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5a5d4-89f7-48a8-8967-3ae4a7ccb386 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:41.517194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:41.517874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:41.518152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:41.518426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:41.519235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:41.519530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:41.520905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:41.530355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 595/1209] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:07:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:41.536445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:41.592935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:41.643746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c8887-431b-4507-8f8a-1d3d5014885a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:41.679344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:41.680272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:41.680650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:41.681042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:41.695784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:41.697578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:41.719795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:41.720901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:41.721827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:41.721827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:41.721827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:41.721827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:41.721827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 615/1210] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:41.726947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:41.830968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:41.834082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f404aa-e06f-483a-aefb-d49a27d15a09 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:41.870184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:41.870859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:41.871142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:41.871413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:41.872174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:41.872482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:41.873897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:41.886945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 596/1211] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:41.893141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:42.003425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b5296-66aa-475e-b169-5484dd28fb52 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:42.005028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:42.041732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:42.042617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:42.042904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:42.043174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:42.050702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:42.052335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:07:42.068341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:42.069979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:42.070996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 616/1212] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:07:42.076064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:42.184522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ada57-9230-4616-8e52-5b372e7e8fad None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:42.222027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:42.222707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:42.222986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:42.223257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:42.224096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:42.224396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:42.225878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:42.244044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 597/1213] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 18 06:07:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:42.250411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:42.367269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890bc08-a624-4c8a-bde4-2241654d0d11 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:42.406029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:42.406690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:42.406972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:42.407244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:42.440311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:42.482346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:42.483827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:42.600532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 617/1214] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:07:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:07:42.606662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:42.626487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:42.719799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b816-75bc-41ac-80be-478dfbe9eb09 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:42.758462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:42.759267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:42.759545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:42.759902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:42.774011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:42.775547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:42.795707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:42.796962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:42.798045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:42.798045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:42.798045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:42.798045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:42.798045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 598/1215] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:07:42.803371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:42.872612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:42.912828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ff708-66e6-440e-b88e-2474a5336c4a None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:42.950465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:42.951120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:42.951404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:42.951677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:42.952398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:42.952701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:42.954129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:42.967868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 618/1216] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:42.973737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:43.047863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:43.078749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179b2b6-5031-493b-b541-d8a8c48f2255 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:43.121213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:43.122355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:43.122880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:43.123294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:43.133599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:43.138410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:07:43.152022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:43.153254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:43.154314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 599/1217] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:07:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:43.160697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:43.273665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e8bef-40b0-4b4d-8180-75da65f92846 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:43.297686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:43.311212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6f8b-b834-4b34-a16a-c76fbabc5ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:43.311888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6f8b-b834-4b34-a16a-c76fbabc5ddb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:43.312167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6f8b-b834-4b34-a16a-c76fbabc5ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:43.312440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6f8b-b834-4b34-a16a-c76fbabc5ddb None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:43.313261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6f8b-b834-4b34-a16a-c76fbabc5ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:43.313568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6f8b-b834-4b34-a16a-c76fbabc5ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:43.314997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6f8b-b834-4b34-a16a-c76fbabc5ddb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:43.328568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 619/1218] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:07:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:43.335036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:43.438269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092888e-9bd8-4bb9-882d-389d6e7488fa None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:43.466248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:43.471922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb6099-9874-41fc-8254-15bc4269b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:43.472578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb6099-9874-41fc-8254-15bc4269b891 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:43.472858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb6099-9874-41fc-8254-15bc4269b891 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:43.473169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb6099-9874-41fc-8254-15bc4269b891 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:43.474004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb6099-9874-41fc-8254-15bc4269b891 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=5cb84c685c4840a8958ff1a82f2b6f56) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:43.474316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb6099-9874-41fc-8254-15bc4269b891 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:43.475774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb6099-9874-41fc-8254-15bc4269b891 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:43.481739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 600/1219] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:07:43 2022] GET /identity/v3/role_assignments?user.id=5cb84c685c4840a8958ff1a82f2b6f56&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:45.501948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385846-9b65-4654-867b-177530c31e22 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:45.502477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385846-9b65-4654-867b-177530c31e22 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:45.502567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff385846-9b65-4654-867b-177530c31e22 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:45.503913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 620/1220] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:07:45.509279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3da-3804-4a37-912f-40b9ce05208c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:45.509828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3da-3804-4a37-912f-40b9ce05208c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:45.510501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3da-3804-4a37-912f-40b9ce05208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:45.527763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-38ebc3da-3804-4a37-912f-40b9ce05208c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:07:45.529015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-38ebc3da-3804-4a37-912f-40b9ce05208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:07:45.597975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 601/1221] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:07:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:07:45.621464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385846-9b65-4654-867b-177530c31e22 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:45.726092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff385846-9b65-4654-867b-177530c31e22 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:45.760611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:45.761532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:45.761816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:45.762089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:45.772431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:07:45.780916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:45.782772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:45.784420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 621/1222] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:07:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:45.788311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc3da-3804-4a37-912f-40b9ce05208c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:45.895875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc3da-3804-4a37-912f-40b9ce05208c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:45.932713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:45.944146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:45.944813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:45.945196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:45.945476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:45.946219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] RBAC: Adding query filter params (name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:45.946523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:45.948444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:45.956569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 602/1223] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:07:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:45.962542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:46.007991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:46.066339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20394e58-7f11-4716-80a7-685bd8fb5c80 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:46.100456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:46.101269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:46.101550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:46.101822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:46.112811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:46.114286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:46.133307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:46.134442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:46.136452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:46.136452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:46.136452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:46.136452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:46.136452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 622/1224] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:46.140941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:46.247125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7df33-1dc2-44b6-83e6-71f58de8150e None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:46.284518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:46.285215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:46.285498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:46.285777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:46.286508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:46.286813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:46.288208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:46.302155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 603/1225] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:46.309288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:46.408437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:46.415098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6d495-726e-4f45-8545-c84a57b34a9b None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:46.450307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:46.451122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:46.451407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:46.451683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:46.459519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:46.461003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:07:46.475360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:46.476515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:46.477864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 623/1226] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:46.483081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:46.542931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:46.595868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175b13-ff3d-48b1-bd15-e5df71a6da20 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:46.630780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:46.631443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:46.631725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:46.631998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:46.632826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:46.633189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:46.634610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:46.652570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 604/1227] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 18 06:07:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:46.658517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:46.760251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aeb48a-b1e3-4e03-b339-05b63067fab3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:46.794982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:46.795701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:46.795987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:46.796261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:46.807152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:46.808604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:46.825710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:46.826796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:46.828147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:46.828147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:46.828147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:46.828147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:46.828147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 624/1228] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:46.832905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:46.937976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030a884-2f34-4b2b-985f-3ac5af51670c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:46.940326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:46.972304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:46.972991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:46.973284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:46.973564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:46.974284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:46.974593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:46.975963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:46.988403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 605/1229] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:46.994777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:47.004245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:47.093638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de6babf-e39b-4f09-a91f-b1ccfce3e0de None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:47.127153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:47.128587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:47.128587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:47.128587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:47.135170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:47.136687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:07:47.150821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:47.151873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:47.153169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 625/1230] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:47.158966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:47.257532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8752e0b-9e55-4185-862b-a603361ab65a None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:47.290094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b13f61-5ef1-40b9-bef1-84cb8297cb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:47.290821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13f61-5ef1-40b9-bef1-84cb8297cb71 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:47.291794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13f61-5ef1-40b9-bef1-84cb8297cb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:47.292146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b13f61-5ef1-40b9-bef1-84cb8297cb71 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:47.293140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13f61-5ef1-40b9-bef1-84cb8297cb71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:47.293457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13f61-5ef1-40b9-bef1-84cb8297cb71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:47.294899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b13f61-5ef1-40b9-bef1-84cb8297cb71 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:47.309410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 606/1231] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:47.315565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:47.382918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:47.417072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c4cac-4638-47b7-b74e-fa4b49d2a73e None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:47.450466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fbce8-5275-4711-8303-236f60ef8893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:47.451389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbce8-5275-4711-8303-236f60ef8893 None admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:47.451675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbce8-5275-4711-8303-236f60ef8893 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:47.451953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fbce8-5275-4711-8303-236f60ef8893 None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/5cb84c685c4840a8958ff1a82f2b6f56/roles/9ff6030cc666452ea3f178662d71993d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:47.466756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fbce8-5275-4711-8303-236f60ef8893 None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=5cb84c685c4840a8958ff1a82f2b6f56, role_id=9ff6030cc666452ea3f178662d71993d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:47.468319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fbce8-5275-4711-8303-236f60ef8893 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:47.564379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 626/1232] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:07:47 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/5cb84c685c4840a8958ff1a82f2b6f56/roles/9ff6030cc666452ea3f178662d71993d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:07:49.585854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066bfa-3b4c-4eb6-ab35-46528b36eef0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:49.586354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066bfa-3b4c-4eb6-ab35-46528b36eef0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:49.586354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f066bfa-3b4c-4eb6-ab35-46528b36eef0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:49.587710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 607/1233] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:07:49.593715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9027-0f31-4ab3-a55e-c8875d92a8d4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:49.594164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9027-0f31-4ab3-a55e-c8875d92a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:49.594312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac9027-0f31-4ab3-a55e-c8875d92a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:49.610906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-62ac9027-0f31-4ab3-a55e-c8875d92a8d4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:07:49.612070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-62ac9027-0f31-4ab3-a55e-c8875d92a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:07:49.682309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 627/1234] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:07:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:07:49.706852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066bfa-3b4c-4eb6-ab35-46528b36eef0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:49.731668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:49.808380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f066bfa-3b4c-4eb6-ab35-46528b36eef0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:49.844037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:49.844755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:49.845068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:49.845445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:49.855671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:07:49.863283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:49.864434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:49.870705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 608/1235] 10.222.0.27 () {56 vars in 1102 bytes} [Mon Jul 18 06:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:49.872840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9027-0f31-4ab3-a55e-c8875d92a8d4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:49.919305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:49.971918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac9027-0f31-4ab3-a55e-c8875d92a8d4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:50.005053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:50.005675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:50.005961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:50.006235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:50.006981 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] RBAC: Adding query filter params (name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:50.007285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:50.008649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:50.017184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 628/1236] 10.222.0.27 () {56 vars in 1103 bytes} [Mon Jul 18 06:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:50.022955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:50.110606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:50.126627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9421-bb38-4905-85e1-27487340a4cd None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:50.159691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:50.160508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:50.160796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:50.161112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:50.173531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:50.175001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:50.193049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:50.194119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:50.195238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:50.195238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:50.195238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:50.195238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:50.195238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 609/1237] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:50.200094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:50.301900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef2fae2-b519-453e-887f-9dfeb3e65daa None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:50.313329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:50.339006 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:50.339661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:50.339948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:50.340223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:50.340939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:50.341283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:50.342650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:50.354519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 629/1238] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:50.360874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:50.460695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7aa0ab-83ff-471c-8f7b-16c395fe0615 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:50.496194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:50.497022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:50.497313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:50.497590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:50.500370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:50.506366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:50.509494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:07:50.522320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:50.523471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:50.524640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 610/1239] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:50.530751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:50.635209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b858e7-7372-4408-9fbd-e672309bd887 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:50.669266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:50.669946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:50.670233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:50.670508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:50.671355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:50.671667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:50.673141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:50.691720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 630/1240] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 18 06:07:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:50.698424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:50.805189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b84eaa-2bef-44bf-8404-12340628856d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:50.840606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:50.841292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:50.841572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:50.841888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:50.905179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:50.911969 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:50.913591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:51.011809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 611/1241] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:07:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:07:51.017856 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:51.045735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:51.121057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada54d5-3d94-4fa6-a942-96d435f727eb None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:51.157037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:51.157756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:51.158039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:51.158313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:51.169527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:51.170979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:51.189151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:51.190089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:51.191035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:51.191035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:51.191035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:51.191035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:51.191035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 631/1242] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:51.196366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:51.294415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:51.300325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3815bf-0837-43b0-85e5-6bc18cc9d37c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:51.336223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:51.336884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:51.337194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:51.337470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:51.338879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:51.339354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:51.340721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:51.352007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 612/1243] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:51.358379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:51.440198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:51.461525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a459a5f-947a-42f6-b0cf-4512a6c54d54 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:51.497150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:51.497937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:51.498220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:51.498492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:51.505432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:51.506879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:07:51.521713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:51.524529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:51.526836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 632/1244] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:51.530371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:51.644298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a65f-eea1-464e-b605-1786f9ae1e0d None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:51.679917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35380b3e-ec35-4c33-9ba9-3fe3455c5919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:51.680747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380b3e-ec35-4c33-9ba9-3fe3455c5919 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:51.681160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380b3e-ec35-4c33-9ba9-3fe3455c5919 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:51.681522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35380b3e-ec35-4c33-9ba9-3fe3455c5919 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:51.682837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35380b3e-ec35-4c33-9ba9-3fe3455c5919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:51.683237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35380b3e-ec35-4c33-9ba9-3fe3455c5919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:51.684882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35380b3e-ec35-4c33-9ba9-3fe3455c5919 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:51.698289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 613/1245] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:51.705162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:51.809829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feaf4e3-d636-4cdb-aaa9-5c385b86f4b8 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:51.844847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759495c-d4db-4ae7-b0f1-321224d93111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:51.845532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759495c-d4db-4ae7-b0f1-321224d93111 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:51.845863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759495c-d4db-4ae7-b0f1-321224d93111 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:51.846156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759495c-d4db-4ae7-b0f1-321224d93111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:51.846992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759495c-d4db-4ae7-b0f1-321224d93111 None admin] RBAC: Adding query filter params (role.id=9ff6030cc666452ea3f178662d71993d, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=5cb84c685c4840a8958ff1a82f2b6f56) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:51.847304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759495c-d4db-4ae7-b0f1-321224d93111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:51.848735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759495c-d4db-4ae7-b0f1-321224d93111 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:51.855160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 633/1246] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:07:51 2022] GET /identity/v3/role_assignments?user.id=5cb84c685c4840a8958ff1a82f2b6f56&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=9ff6030cc666452ea3f178662d71993d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:53.945918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c588b-59b3-4d24-a871-cbe553812457 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:53.946509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c588b-59b3-4d24-a871-cbe553812457 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:53.946509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c588b-59b3-4d24-a871-cbe553812457 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:53.948957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 614/1247] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:07:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:07:53.954453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8708-02db-47f1-a775-75056b3fc4d2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:53.954916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8708-02db-47f1-a775-75056b3fc4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:53.955085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d8708-02db-47f1-a775-75056b3fc4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:53.960211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:53.973317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cb6d8708-02db-47f1-a775-75056b3fc4d2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:07:53.974566 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cb6d8708-02db-47f1-a775-75056b3fc4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:07:54.042177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 634/1248] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:07:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:07:54.065703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c588b-59b3-4d24-a871-cbe553812457 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:54.085238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:54.174351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c588b-59b3-4d24-a871-cbe553812457 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:54.209309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:54.210090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:54.210384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:54.210664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:54.222161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:07:54.230394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:54.231492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:54.232328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 615/1249] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:54.237861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d8708-02db-47f1-a775-75056b3fc4d2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:54.341309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d8708-02db-47f1-a775-75056b3fc4d2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:54.371549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:54.376253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:54.376957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:54.377262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:54.377533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:54.378282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:54.378583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:54.379940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:54.389341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 635/1250] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:54.395284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:54.475457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:54.499467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc97544-a359-4728-b9d7-9407a38a3130 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:54.534731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:54.535723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:54.536245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:54.536582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:54.548435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:54.549917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:54.568353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:54.572648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:54.573918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:54.573918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:54.573918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:54.573918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:54.573918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 616/1251] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:54.575674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:54.678132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f96e60-8c49-4425-8f94-3cf06d19acf7 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:54.712717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:54.713430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:54.713916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:54.714374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:54.715154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:54.715468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:54.716899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:54.732084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 636/1252] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:54.738059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:54.848772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f071b69-5ed5-449b-a11c-b6c75dbb3300 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:54.877612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:54.885812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:54.886614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:54.886897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:54.887171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:54.895007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:54.896440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:07:54.911965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:54.914686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:54.917252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 617/1253] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:54.919415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:54.977755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:55.021970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29873775-9ba7-48ae-b878-efa3908f9303 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:55.057960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:55.058634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:55.058916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:55.059189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:55.060079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:55.060391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:55.061862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:55.079501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 637/1254] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 18 06:07:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:55.085757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:55.188647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bef95a-75bf-4e08-a9da-eeefca29c083 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:55.222632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:55.223291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:55.223577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:55.223855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:55.280558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:55.293312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:55.294790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:55.394787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 618/1255] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:07:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:07:55.401148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:55.501241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0570e640-adac-4091-8dfa-a676d0e32b67 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:55.514859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:55.535744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:55.536454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:55.536743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:55.537045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:55.546842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:55.548299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:55.565567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:55.566621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:55.567910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:55.567910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:55.567910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:55.567910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:55.567910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 638/1256] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:55.573223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:55.661683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:55.675867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f55a3-a27f-488a-baa4-64e15c08bda6 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:55.710021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:55.710688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:55.710973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:55.711253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:55.711970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:55.712279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:55.713802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:55.725190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 619/1257] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:55.731364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:55.831771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff595387-ec73-4144-91b4-f6fa60a868d4 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:55.866778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:55.867592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:55.867918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:55.868195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:55.876585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:55.878088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:07:55.893123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:55.894205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:07:55.895305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 639/1258] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:55.900331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:56.000799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa0d416-8749-476a-9452-7467651a1f31 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:56.036794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121d5b3-6d58-4574-a220-9085ef3a2739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:56.037567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d5b3-6d58-4574-a220-9085ef3a2739 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:56.037853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d5b3-6d58-4574-a220-9085ef3a2739 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:56.038157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121d5b3-6d58-4574-a220-9085ef3a2739 None admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:56.039104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121d5b3-6d58-4574-a220-9085ef3a2739 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:56.039457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121d5b3-6d58-4574-a220-9085ef3a2739 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:56.041668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e121d5b3-6d58-4574-a220-9085ef3a2739 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:56.055212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 620/1259] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:56.062240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:56.088888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:56.164617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548fbf4-c5d6-4d46-9a29-5e578b3771c0 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:56.199514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab26dc-5733-4943-a750-09afc0661004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:56.200163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab26dc-5733-4943-a750-09afc0661004 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:56.200445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab26dc-5733-4943-a750-09afc0661004 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:56.200719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab26dc-5733-4943-a750-09afc0661004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:56.201584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab26dc-5733-4943-a750-09afc0661004 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=5cb84c685c4840a8958ff1a82f2b6f56) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:56.201896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab26dc-5733-4943-a750-09afc0661004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:56.203369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab26dc-5733-4943-a750-09afc0661004 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:56.208927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 640/1260] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:07:56 2022] GET /identity/v3/role_assignments?user.id=5cb84c685c4840a8958ff1a82f2b6f56&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=a30b539353cf42d08ab504edac924aa8 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:58.196189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8046-abcb-4b71-a61b-79f0763660be None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:58.196744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8046-abcb-4b71-a61b-79f0763660be None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:58.196744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d8046-abcb-4b71-a61b-79f0763660be None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:58.198783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 621/1261] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:07:58.204295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57714c94-4ab8-4ba5-b698-89b7cca011a0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:58.206771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57714c94-4ab8-4ba5-b698-89b7cca011a0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:58.206771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57714c94-4ab8-4ba5-b698-89b7cca011a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:58.221266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-57714c94-4ab8-4ba5-b698-89b7cca011a0 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:07:58.222477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-57714c94-4ab8-4ba5-b698-89b7cca011a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:07:58.292752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 641/1262] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:07:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:07:58.316566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8046-abcb-4b71-a61b-79f0763660be None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:58.328097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:58.424251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4d8046-abcb-4b71-a61b-79f0763660be None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:58.463317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:58.464129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:58.464672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:58.464672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:58.475912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:07:58.484532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:58.486870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:58.488783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 622/1263] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:07:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:58.492931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57714c94-4ab8-4ba5-b698-89b7cca011a0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:58.511880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:58.601199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57714c94-4ab8-4ba5-b698-89b7cca011a0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:58.637960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:58.638690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:58.638977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:58.639256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:58.640014 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:58.640328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:58.641727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:58.651069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 642/1264] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:07:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:58.656871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:58.730301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:58.766212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484f29cf-fac9-403a-9dd1-acbee7f460c1 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:58.810202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:58.811007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:58.811299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:58.811589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:58.823432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:58.824897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:58.843213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:58.844531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:58.846039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:58.846039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:58.846039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:58.846039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:58.846039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 623/1265] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:58.850844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:58.940891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:58.960175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d84af2-3ac5-4d35-8750-b72248ba6c29 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:58.998412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:58.999151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:58.999477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:58.999826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:59.000632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:59.000999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:59.006889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:59.015353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 643/1266] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:59.021232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:59.124528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bd2ab-cefc-49c5-b5f3-6afe1b5a0574 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:59.144811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:59.158615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:59.159653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:59.159938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:59.160218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:59.171329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:59.172770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:07:59.188433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:59.195190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:59.196815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 624/1267] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:59.197680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:59.296576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf9064-b57d-4df0-bcce-b9805aaadafd None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:59.332007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:59.332681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:59.332968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:59.333274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:59.334116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:59.334428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:59.335882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:59.346294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:59.355126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 644/1268] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 18 06:07:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:59.361604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:59.465042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632f74a-0226-4a67-8908-886c49d56be7 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:59.499847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:59.500639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:59.500925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:59.501234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:59.512401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:59.513966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:07:59.532644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:59.533790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:59.534700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:07:59.534700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:07:59.534700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:07:59.534700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:59.534700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 625/1269] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:59.540138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:59.645876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3169a-1675-4f6f-bc55-201a46246e82 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:59.682366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:59.683034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:59.683317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:59.683591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:59.684316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:07:59.684667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:59.686094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:59.697843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 645/1270] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:07:59.704330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:59.739322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:07:59.811927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c25dca-68cc-4999-a1fc-d438da2c097c None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:07:59.845241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:07:59.846034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:07:59.846313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:07:59.846588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:07:59.853848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:07:59.855645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:07:59.871130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:07:59.877346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:07:59.879719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 626/1271] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:07:59.880963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:07:59.962389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:00.024859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e2eb4-9238-4680-98ba-0f5193622c2f None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:00.062824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c70603-89bc-4839-b2d9-0d6fbd041844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:00.063485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70603-89bc-4839-b2d9-0d6fbd041844 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:00.063771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70603-89bc-4839-b2d9-0d6fbd041844 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:00.064052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c70603-89bc-4839-b2d9-0d6fbd041844 None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:00.064847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c70603-89bc-4839-b2d9-0d6fbd041844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:00.065190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c70603-89bc-4839-b2d9-0d6fbd041844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:00.066718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c70603-89bc-4839-b2d9-0d6fbd041844 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:00.081563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 646/1272] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:00.088380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:00.183081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:00.192140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629fbdc5-e2d8-495b-b0eb-fbf46ee2297b None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:00.226331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab0f9c-7815-43d9-a9ef-49f94007d02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:00.227155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0f9c-7815-43d9-a9ef-49f94007d02b None admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:00.227445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0f9c-7815-43d9-a9ef-49f94007d02b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:00.227725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab0f9c-7815-43d9-a9ef-49f94007d02b None admin] PATH_INFO: `/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/5cb84c685c4840a8958ff1a82f2b6f56/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:00.229861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0f9c-7815-43d9-a9ef-49f94007d02b None admin] RBAC: Authorizing `identity:create_grant(project_id=de12dff50560499ca0b5cd3165bb22fd, user_id=5cb84c685c4840a8958ff1a82f2b6f56, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:00.231301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab0f9c-7815-43d9-a9ef-49f94007d02b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:00.378069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 627/1273] 10.222.0.27 () {58 vars in 1439 bytes} [Mon Jul 18 06:08:00 2022] PUT /identity/v3/projects/de12dff50560499ca0b5cd3165bb22fd/users/5cb84c685c4840a8958ff1a82f2b6f56/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:08:02.408527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512f1c4-0254-4291-84ae-0b799fcdfb9a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:02.409101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512f1c4-0254-4291-84ae-0b799fcdfb9a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:02.409101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512f1c4-0254-4291-84ae-0b799fcdfb9a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:02.410494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 647/1274] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:08:02.416497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2411-e293-449f-8277-ab6ded08c77f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:02.416962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2411-e293-449f-8277-ab6ded08c77f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:02.417330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f2411-e293-449f-8277-ab6ded08c77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:02.433796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-485f2411-e293-449f-8277-ab6ded08c77f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:08:02.434990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-485f2411-e293-449f-8277-ab6ded08c77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:08:02.501270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 628/1275] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:08:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:08:02.524664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512f1c4-0254-4291-84ae-0b799fcdfb9a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:02.628214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512f1c4-0254-4291-84ae-0b799fcdfb9a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:02.644924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:02.662213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:02.663014 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:02.663297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:02.663570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:02.674853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 06:08:02.682868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:02.683977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:02.685116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 648/1276] 10.222.0.27 () {56 vars in 1096 bytes} [Mon Jul 18 06:08:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:08:02.690249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f2411-e293-449f-8277-ab6ded08c77f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:02.773525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:02.791981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f2411-e293-449f-8277-ab6ded08c77f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:02.827258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:02.828246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:02.828246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:02.828485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:02.829242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:02.829550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:02.830920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:02.839929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 629/1277] 10.222.0.27 () {56 vars in 1099 bytes} [Mon Jul 18 06:08:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:02.845810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:02.951342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f2f94-5347-4079-8cc2-6431428e76c6 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:02.986576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:02.987667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:02.988127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:02.988412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:03.001197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:03.009178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:08:03.020764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:03.021888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:03.022930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:08:03.022930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:08:03.022930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:08:03.022930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:03.022930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 649/1278] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:08:03.029530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:03.134852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17293c-b605-4c81-bf55-7952a620d492 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:03.171714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:03.172384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:03.172668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:03.172942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:03.173706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:03.174010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:03.175379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:03.187959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 630/1279] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:03.193925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:03.226556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:03.296322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4ee9d-3763-4d59-82a3-bab2e7ac51c1 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:03.333719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:03.334527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:03.334812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:03.335090 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:03.343183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:03.348237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 06:08:03.360151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:03.361457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:03.362820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 650/1280] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:08:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:08:03.367278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:03.371806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:03.472697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da3978-ac8e-4452-8bf9-ae50eed1d453 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:03.508273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:03.508864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:03.509181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:03.510203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:03.510946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:03.511257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:03.512687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:03.530205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 631/1281] 10.222.0.27 () {56 vars in 1143 bytes} [Mon Jul 18 06:08:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:03.536117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:03.632809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:03.642445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c175624-e6c2-4792-8bb2-2c161e72b7c3 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:03.676678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:03.677446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:03.677731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:03.678010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:03.747894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:03.749373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:03.843552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:03.854792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 651/1282] 10.222.0.27 () {58 vars in 1282 bytes} [Mon Jul 18 06:08:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 06:08:03.861105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:03.930078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:03.973776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4577c-fdad-4f83-9a1d-cb34cb485a55 None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:04.009293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:04.010610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:04.010716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:04.010992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:04.021070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:04.022576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 06:08:04.041680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:04.042765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:04.043880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 06:08:04.043880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 06:08:04.043880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 06:08:04.043880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:08:04.043880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 632/1283] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 06:08:04.048832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:04.147700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398793c-b25c-41d0-b5cc-1e3eb89588b2 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:04.183502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:04.184159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:04.184483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:04.184741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:04.185488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:04.185789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:04.187147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:04.198385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 652/1284] 10.222.0.27 () {56 vars in 1109 bytes} [Mon Jul 18 06:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:04.204066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:04.306039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0ec8-334f-4830-8cd7-31953b53bf0f None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:04.320879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:04.340850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:04.341675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:04.341962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:04.342244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:04.349162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:04.350607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 06:08:04.367552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:04.368630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: ERROR keystone.server.flask.application Jul 18 06:08:04.370693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 633/1285] 10.222.0.27 () {56 vars in 1111 bytes} [Mon Jul 18 06:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:08:04.375624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:04.425150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:04.474718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c1c515-6f22-4cc8-9c79-265a66a53587 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:04.509522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22964bfe-de7c-429e-ae05-93b62c6eda8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:04.510196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22964bfe-de7c-429e-ae05-93b62c6eda8a None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:04.510477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22964bfe-de7c-429e-ae05-93b62c6eda8a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:04.510753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22964bfe-de7c-429e-ae05-93b62c6eda8a None admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:04.511549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22964bfe-de7c-429e-ae05-93b62c6eda8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:04.511863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22964bfe-de7c-429e-ae05-93b62c6eda8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:04.513455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22964bfe-de7c-429e-ae05-93b62c6eda8a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:04.526241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 653/1286] 10.222.0.27 () {56 vars in 1148 bytes} [Mon Jul 18 06:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:04.532735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:04.634750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d58bb-1a57-4df3-a9d6-69b0343171ac None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:04.669367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead74f0-091f-4dea-9344-d13afe92ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:04.670020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead74f0-091f-4dea-9344-d13afe92ab37 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:04.670366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead74f0-091f-4dea-9344-d13afe92ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:04.670590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead74f0-091f-4dea-9344-d13afe92ab37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:04.671426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead74f0-091f-4dea-9344-d13afe92ab37 None admin] RBAC: Adding query filter params (role.id=a30b539353cf42d08ab504edac924aa8, scope.project.id=de12dff50560499ca0b5cd3165bb22fd, user.id=5cb84c685c4840a8958ff1a82f2b6f56) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:04.671735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead74f0-091f-4dea-9344-d13afe92ab37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:04.673197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eead74f0-091f-4dea-9344-d13afe92ab37 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:04.679710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 634/1287] 10.222.0.27 () {56 vars in 1374 bytes} [Mon Jul 18 06:08:04 2022] GET /identity/v3/role_assignments?user.id=5cb84c685c4840a8958ff1a82f2b6f56&scope.project.id=de12dff50560499ca0b5cd3165bb22fd&role.id=a30b539353cf42d08ab504edac924aa8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:06.731185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578b5f-969a-4261-89e4-6cb15a3635fb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:06.731812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578b5f-969a-4261-89e4-6cb15a3635fb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:06.731812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578b5f-969a-4261-89e4-6cb15a3635fb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:06.733165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 654/1288] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:08:06.738795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533079-a852-45fa-a1b9-075450c67c6d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:06.739291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533079-a852-45fa-a1b9-075450c67c6d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:06.739385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79533079-a852-45fa-a1b9-075450c67c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:06.757090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-79533079-a852-45fa-a1b9-075450c67c6d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:08:06.758352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-79533079-a852-45fa-a1b9-075450c67c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:08:06.788718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:06.828550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 635/1289] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:08:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 06:08:06.850941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578b5f-969a-4261-89e4-6cb15a3635fb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:06.958462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578b5f-969a-4261-89e4-6cb15a3635fb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:06.970093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:06.994633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:06.995309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:06.995597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:06.995874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:06.996532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:06.997931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:07.009818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:07.011273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:07.012305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:07.016109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 655/1290] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:08:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:08:07.017184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533079-a852-45fa-a1b9-075450c67c6d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:07.138463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79533079-a852-45fa-a1b9-075450c67c6d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:07.174980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31b562-b44f-4006-a9af-3227f95cdaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:07.175879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31b562-b44f-4006-a9af-3227f95cdaef None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:07.176171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31b562-b44f-4006-a9af-3227f95cdaef None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:07.176451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31b562-b44f-4006-a9af-3227f95cdaef None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:07.177245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31b562-b44f-4006-a9af-3227f95cdaef None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:07.178609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31b562-b44f-4006-a9af-3227f95cdaef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:07.179256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd31b562-b44f-4006-a9af-3227f95cdaef None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:07.184840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 636/1291] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 18 06:08:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:08:07.191642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:07.299684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f5ad06-1afc-4f2e-9b1d-ab8e641c135c None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:07.337310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c14cd-f9b8-4c5e-9d61-b7b422c7d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:07.338697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c14cd-f9b8-4c5e-9d61-b7b422c7d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:07.338984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c14cd-f9b8-4c5e-9d61-b7b422c7d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:07.339355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c14cd-f9b8-4c5e-9d61-b7b422c7d8a6 None admin] PATH_INFO: `/v3/services` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:07.340069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c14cd-f9b8-4c5e-9d61-b7b422c7d8a6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:07.340374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c14cd-f9b8-4c5e-9d61-b7b422c7d8a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:07.341772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c14cd-f9b8-4c5e-9d61-b7b422c7d8a6 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:07.346272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 656/1292] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 18 06:08:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:09.402710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a138b-93a1-4a6b-a824-3beae250bcfd None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:09.403237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a138b-93a1-4a6b-a824-3beae250bcfd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:09.403352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a138b-93a1-4a6b-a824-3beae250bcfd None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:09.404662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 637/1293] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:08:09.410259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529364ba-d57d-42f1-b9bf-a6207c99fcd1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:09.410672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529364ba-d57d-42f1-b9bf-a6207c99fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:09.410849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529364ba-d57d-42f1-b9bf-a6207c99fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:09.428850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-529364ba-d57d-42f1-b9bf-a6207c99fcd1 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:08:09.430348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-529364ba-d57d-42f1-b9bf-a6207c99fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:08:09.460534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:09.498003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 657/1294] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:08:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:08:09.522030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a138b-93a1-4a6b-a824-3beae250bcfd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:09.556080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:09.629300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a138b-93a1-4a6b-a824-3beae250bcfd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:09.663664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6599089-c2f9-429c-ae71-cdff8a48e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:09.664358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599089-c2f9-429c-ae71-cdff8a48e403 None admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:09.664608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599089-c2f9-429c-ae71-cdff8a48e403 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:09.664886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6599089-c2f9-429c-ae71-cdff8a48e403 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:09.666184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6599089-c2f9-429c-ae71-cdff8a48e403 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:09.667625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6599089-c2f9-429c-ae71-cdff8a48e403 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:09.773000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 638/1295] 10.222.0.27 () {60 vars in 1141 bytes} [Mon Jul 18 06:08:09 2022] POST /identity/v3/services => generated 246 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:08:11.828559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd910-5ed4-4460-9dc8-8489b90555d7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:11.829177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd910-5ed4-4460-9dc8-8489b90555d7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:11.829177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd910-5ed4-4460-9dc8-8489b90555d7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:11.830578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 658/1296] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:08:11.835861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2552c8-0654-4673-b96d-d5c2410bc2ab None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:11.836292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2552c8-0654-4673-b96d-d5c2410bc2ab None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:11.836427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2552c8-0654-4673-b96d-d5c2410bc2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:11.853947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8a2552c8-0654-4673-b96d-d5c2410bc2ab None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:08:11.855146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8a2552c8-0654-4673-b96d-d5c2410bc2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:08:11.930751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 639/1297] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:08:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:08:11.954052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd910-5ed4-4460-9dc8-8489b90555d7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:12.057692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd910-5ed4-4460-9dc8-8489b90555d7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:12.093526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:12.094248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:12.094556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:12.094835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:12.095490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:12.096881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:12.110914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:12.114247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:12.115276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 659/1298] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:08:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:08:12.118438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2552c8-0654-4673-b96d-d5c2410bc2ab None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:12.137661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:12.219051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2552c8-0654-4673-b96d-d5c2410bc2ab None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:12.262672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:12.263359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:12.263645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:12.263923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:12.264650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:12.264959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:12.266417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:12.272390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 640/1299] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 18 06:08:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:12.278958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:12.315166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:12.394309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389438b-07b4-4830-a3fe-e8992df5a006 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:12.428820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edf958-fc53-4299-948c-2e785503797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:12.429754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edf958-fc53-4299-948c-2e785503797f None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:12.430041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edf958-fc53-4299-948c-2e785503797f None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:12.430320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edf958-fc53-4299-948c-2e785503797f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:12.431716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edf958-fc53-4299-948c-2e785503797f None admin] RBAC: Adding query filter params (interface=public, service_id=74f8c771c43f47ecb49584fa1fa0512e, region_id=RegionOne) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:12.432642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edf958-fc53-4299-948c-2e785503797f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:12.433537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2edf958-fc53-4299-948c-2e785503797f None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:12.438728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 660/1300] 10.222.0.27 () {56 vars in 1251 bytes} [Mon Jul 18 06:08:12 2022] GET /identity/v3/endpoints?service_id=74f8c771c43f47ecb49584fa1fa0512e&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:12.444592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:12.528065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:12.546610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f818-ebe9-413e-9484-48e37707daea None admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:12.580791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706b825-4b40-4fbd-8150-30ffeeaff02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:12.581486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706b825-4b40-4fbd-8150-30ffeeaff02b None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:12.581775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706b825-4b40-4fbd-8150-30ffeeaff02b None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:12.582121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706b825-4b40-4fbd-8150-30ffeeaff02b None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:12.582739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706b825-4b40-4fbd-8150-30ffeeaff02b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:12.584110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706b825-4b40-4fbd-8150-30ffeeaff02b None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:12.592316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 641/1301] 10.222.0.27 () {56 vars in 1087 bytes} [Mon Jul 18 06:08:12 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:08:14.638912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766313-c6b1-4cf7-b0a6-923013e25489 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:14.639435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766313-c6b1-4cf7-b0a6-923013e25489 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:14.639435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3766313-c6b1-4cf7-b0a6-923013e25489 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:14.640872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 661/1302] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:08:14.646460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01253-b7a1-48d2-9f84-df0f310c8675 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:14.646862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01253-b7a1-48d2-9f84-df0f310c8675 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:14.647667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01253-b7a1-48d2-9f84-df0f310c8675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:14.663803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4de01253-b7a1-48d2-9f84-df0f310c8675 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:08:14.665009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4de01253-b7a1-48d2-9f84-df0f310c8675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:08:14.736937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 642/1303] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:08:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 06:08:14.760934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766313-c6b1-4cf7-b0a6-923013e25489 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:14.863130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:14.870795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3766313-c6b1-4cf7-b0a6-923013e25489 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:14.909342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:14.910159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:14.910441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:14.910718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:14.911386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:14.912780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 06:08:14.926023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 06:08:14.927420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application with Lock( Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self._enter() Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application return self.creator() Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application created_value = creator( Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: ERROR keystone.server.flask.application Jul 18 06:08:14.928531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 662/1304] 10.222.0.27 () {56 vars in 1117 bytes} [Mon Jul 18 06:08:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 06:08:14.935111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01253-b7a1-48d2-9f84-df0f310c8675 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:15.021020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:15.048564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de01253-b7a1-48d2-9f84-df0f310c8675 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:15.082838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9b785-be3b-4855-a72f-02d89be20965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:15.083508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b785-be3b-4855-a72f-02d89be20965 None admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:15.083789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b785-be3b-4855-a72f-02d89be20965 None admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:15.084064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9b785-be3b-4855-a72f-02d89be20965 None admin] PATH_INFO: `/v3/services` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:15.084794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9b785-be3b-4855-a72f-02d89be20965 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:08:15.085134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9b785-be3b-4855-a72f-02d89be20965 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:15.086502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9b785-be3b-4855-a72f-02d89be20965 None admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:15.092398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 643/1305] 10.222.0.27 () {56 vars in 1116 bytes} [Mon Jul 18 06:08:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:08:15.098238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:08:15.201449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885306-734f-4a80-a959-faa682b97626 None admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:08:15.235457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d7e73-8eac-4216-9e9d-9751209cbb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:08:15.236110 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d7e73-8eac-4216-9e9d-9751209cbb9a None admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:08:15.236397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d7e73-8eac-4216-9e9d-9751209cbb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:08:15.236677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d7e73-8eac-4216-9e9d-9751209cbb9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:08:15.237450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d7e73-8eac-4216-9e9d-9751209cbb9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:08:15.238820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d7e73-8eac-4216-9e9d-9751209cbb9a None admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:08:15.315850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 663/1306] 10.222.0.27 () {60 vars in 1144 bytes} [Mon Jul 18 06:08:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:08:25.103825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=30 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:08:25.310799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:30.194839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c1b94-d494-40b1-bbd9-3fd0c2baee5e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:30.195410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c1b94-d494-40b1-bbd9-3fd0c2baee5e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:30.195410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954c1b94-d494-40b1-bbd9-3fd0c2baee5e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:30.203051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37f988-b4d5-47b5-832a-434120a94781 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:30.203557 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37f988-b4d5-47b5-832a-434120a94781 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:30.203677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d37f988-b4d5-47b5-832a-434120a94781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:30.207001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 644/1307] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:30.283208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d37f988-b4d5-47b5-832a-434120a94781 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:30.285516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d37f988-b4d5-47b5-832a-434120a94781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:30.530391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 664/1308] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:15:30.590806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99657d-8426-473c-8a55-326aa4975da0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:30.591200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99657d-8426-473c-8a55-326aa4975da0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:30.591654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e99657d-8426-473c-8a55-326aa4975da0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:30.593236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 645/1309] 10.222.0.27 () {54 vars in 965 bytes} [Mon Jul 18 06:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:30.600055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f73f-6811-4a4c-9f72-89bda6c00f1e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:30.600483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f73f-6811-4a4c-9f72-89bda6c00f1e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:30.600876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a7f73f-6811-4a4c-9f72-89bda6c00f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:30.689895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-99a7f73f-6811-4a4c-9f72-89bda6c00f1e None None] MFA Rules not processed for user `aff4923457aa4be498f954c73f4d0018`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:30.691343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-99a7f73f-6811-4a4c-9f72-89bda6c00f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:30.714220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:30.776968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 665/1310] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Jul 18 06:15:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:30.786820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99657d-8426-473c-8a55-326aa4975da0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:30.788565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0e99657d-8426-473c-8a55-326aa4975da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:30.910742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e99657d-8426-473c-8a55-326aa4975da0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:30.992439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f472cae-ab2a-4c28-930f-ce0e1640fa99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:30.993153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472cae-ab2a-4c28-930f-ce0e1640fa99 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:30.993448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472cae-ab2a-4c28-930f-ce0e1640fa99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:30.993726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f472cae-ab2a-4c28-930f-ce0e1640fa99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:30.995367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4f472cae-ab2a-4c28-930f-ce0e1640fa99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:31.057826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:31.132687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f472cae-ab2a-4c28-930f-ce0e1640fa99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:31.134222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f472cae-ab2a-4c28-930f-ce0e1640fa99 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:31.155457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 646/1311] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:33.470199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98305-14de-41f6-bbb5-214ff85fdbf8 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:33.470753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98305-14de-41f6-bbb5-214ff85fdbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:33.470753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c98305-14de-41f6-bbb5-214ff85fdbf8 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:33.472315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 666/1312] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:33.478223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f45c92-ac82-40f1-9b00-99b15c7a1477 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:33.478750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f45c92-ac82-40f1-9b00-99b15c7a1477 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:33.478750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f45c92-ac82-40f1-9b00-99b15c7a1477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:33.569279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f5f45c92-ac82-40f1-9b00-99b15c7a1477 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:33.570549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f5f45c92-ac82-40f1-9b00-99b15c7a1477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:33.672733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 647/1313] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:33.723931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44ac7-a177-4e2d-afd6-fb3d082a29e5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:33.724317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44ac7-a177-4e2d-afd6-fb3d082a29e5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:33.724727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b44ac7-a177-4e2d-afd6-fb3d082a29e5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:33.726183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 667/1314] 10.222.0.27 () {54 vars in 965 bytes} [Mon Jul 18 06:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:33.732851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613ce1-c911-4c1d-bc0c-bf7a9802ea39 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:33.733204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613ce1-c911-4c1d-bc0c-bf7a9802ea39 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:33.733475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5613ce1-c911-4c1d-bc0c-bf7a9802ea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:33.744852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:33.809600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d5613ce1-c911-4c1d-bc0c-bf7a9802ea39 None None] MFA Rules not processed for user `aff4923457aa4be498f954c73f4d0018`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:33.810847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d5613ce1-c911-4c1d-bc0c-bf7a9802ea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:33.891416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 648/1315] 10.222.0.27 () {58 vars in 1062 bytes} [Mon Jul 18 06:15:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:15:33.900420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44ac7-a177-4e2d-afd6-fb3d082a29e5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:33.902369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89b44ac7-a177-4e2d-afd6-fb3d082a29e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:34.008341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b44ac7-a177-4e2d-afd6-fb3d082a29e5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:34.079929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:34.082524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4329db-61e6-42b1-8fd2-55fdfd8299ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:34.083159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4329db-61e6-42b1-8fd2-55fdfd8299ac service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:34.083440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4329db-61e6-42b1-8fd2-55fdfd8299ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:34.083714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4329db-61e6-42b1-8fd2-55fdfd8299ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:34.085383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5a4329db-61e6-42b1-8fd2-55fdfd8299ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:34.196179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4329db-61e6-42b1-8fd2-55fdfd8299ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:34.197644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4329db-61e6-42b1-8fd2-55fdfd8299ac service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:34.215512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 668/1316] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:37.004257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40b3e-14d0-4999-a433-b3b11fad5e1e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:37.004865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40b3e-14d0-4999-a433-b3b11fad5e1e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:37.004865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f40b3e-14d0-4999-a433-b3b11fad5e1e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:37.006145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 649/1317] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:37.011582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb181699-58c3-49b3-a3b1-2bfd1670469a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:37.012025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb181699-58c3-49b3-a3b1-2bfd1670469a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:37.012133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb181699-58c3-49b3-a3b1-2bfd1670469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:37.077209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fb181699-58c3-49b3-a3b1-2bfd1670469a None None] MFA Rules not processed for user `820e7098b5fc456da790361acd082164`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:37.078421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fb181699-58c3-49b3-a3b1-2bfd1670469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:37.129157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:37.172758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 669/1318] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:37.212871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40b3e-14d0-4999-a433-b3b11fad5e1e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:37.214417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21f40b3e-14d0-4999-a433-b3b11fad5e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:37.318871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f40b3e-14d0-4999-a433-b3b11fad5e1e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:37.321699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:37.392469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab9b13-6794-4ce4-8d0b-55621fc1013d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:37.393161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9b13-6794-4ce4-8d0b-55621fc1013d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:37.393452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9b13-6794-4ce4-8d0b-55621fc1013d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:37.393731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab9b13-6794-4ce4-8d0b-55621fc1013d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:37.395400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-72ab9b13-6794-4ce4-8d0b-55621fc1013d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:37.505695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab9b13-6794-4ce4-8d0b-55621fc1013d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:37.507130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab9b13-6794-4ce4-8d0b-55621fc1013d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:37.525666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 650/1319] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:40.387560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617edc4-8b9c-46f8-a968-fa62728832d0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:40.388124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617edc4-8b9c-46f8-a968-fa62728832d0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:40.388256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2617edc4-8b9c-46f8-a968-fa62728832d0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:40.389714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 670/1320] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:40.395190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effba6c-3517-482a-9108-78527817d829 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:40.395613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effba6c-3517-482a-9108-78527817d829 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:40.395744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effba6c-3517-482a-9108-78527817d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:40.435975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:40.460073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2effba6c-3517-482a-9108-78527817d829 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:40.461297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2effba6c-3517-482a-9108-78527817d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:40.557987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 651/1321] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:40.597059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617edc4-8b9c-46f8-a968-fa62728832d0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:40.598772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2617edc4-8b9c-46f8-a968-fa62728832d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:40.702357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2617edc4-8b9c-46f8-a968-fa62728832d0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:40.775567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44666783-432f-434f-ab39-0ffb17fde4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:40.776211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666783-432f-434f-ab39-0ffb17fde4be service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:40.776493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666783-432f-434f-ab39-0ffb17fde4be service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:40.776766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44666783-432f-434f-ab39-0ffb17fde4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:40.778428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-44666783-432f-434f-ab39-0ffb17fde4be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:40.786765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:40.887574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44666783-432f-434f-ab39-0ffb17fde4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:40.889448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44666783-432f-434f-ab39-0ffb17fde4be service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:40.907709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 671/1322] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:44.055454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619137f-905b-406c-9478-6f1c9e111510 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:44.056060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619137f-905b-406c-9478-6f1c9e111510 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:44.056060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619137f-905b-406c-9478-6f1c9e111510 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:44.057472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 652/1323] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:44.063670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3d11-8623-4665-99ed-51c8d45805e0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:44.064078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3d11-8623-4665-99ed-51c8d45805e0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:44.064310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a3d11-8623-4665-99ed-51c8d45805e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:44.131967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ad3a3d11-8623-4665-99ed-51c8d45805e0 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:44.133118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad3a3d11-8623-4665-99ed-51c8d45805e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:44.193193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:44.233891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 672/1324] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:44.269546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619137f-905b-406c-9478-6f1c9e111510 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:44.271112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7619137f-905b-406c-9478-6f1c9e111510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:44.385964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619137f-905b-406c-9478-6f1c9e111510 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:44.399336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:44.472189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74697f-7e04-4e89-9f32-2c1aa8bf81ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:44.472856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74697f-7e04-4e89-9f32-2c1aa8bf81ef service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:44.473179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74697f-7e04-4e89-9f32-2c1aa8bf81ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:44.473465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74697f-7e04-4e89-9f32-2c1aa8bf81ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:44.475218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fc74697f-7e04-4e89-9f32-2c1aa8bf81ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:44.592913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74697f-7e04-4e89-9f32-2c1aa8bf81ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:44.594385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74697f-7e04-4e89-9f32-2c1aa8bf81ef service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:44.613103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 653/1325] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:46.704791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da700-00ca-4c92-b745-722e070a5cbb None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:46.705379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da700-00ca-4c92-b745-722e070a5cbb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:46.705379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da700-00ca-4c92-b745-722e070a5cbb None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:46.706880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 673/1326] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:46.712317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed305-711d-40f9-a053-1676b89ce826 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:46.712751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed305-711d-40f9-a053-1676b89ce826 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:46.712878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daed305-711d-40f9-a053-1676b89ce826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:46.759274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:46.777949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3daed305-711d-40f9-a053-1676b89ce826 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:46.779389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3daed305-711d-40f9-a053-1676b89ce826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:46.880788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 654/1327] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:46.916849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da700-00ca-4c92-b745-722e070a5cbb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:46.918435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-091da700-00ca-4c92-b745-722e070a5cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:47.026223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da700-00ca-4c92-b745-722e070a5cbb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:47.102062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf0a4-a033-43dc-bb69-d9a06e1e9da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:47.102708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf0a4-a033-43dc-bb69-d9a06e1e9da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:47.102988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf0a4-a033-43dc-bb69-d9a06e1e9da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:47.103256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf0a4-a033-43dc-bb69-d9a06e1e9da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:47.104920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-82ecf0a4-a033-43dc-bb69-d9a06e1e9da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:47.122985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:47.217751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf0a4-a033-43dc-bb69-d9a06e1e9da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:47.219189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf0a4-a033-43dc-bb69-d9a06e1e9da9 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:47.238421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 674/1328] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:49.358744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dca5f-cb1a-436c-b340-1fe606317cef None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:49.359306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dca5f-cb1a-436c-b340-1fe606317cef None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:49.359306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75dca5f-cb1a-436c-b340-1fe606317cef None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:49.360753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 655/1329] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:15:49.366322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024c75-f364-421c-9e0e-8cbd98a70fc6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:49.366815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024c75-f364-421c-9e0e-8cbd98a70fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:49.366911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23024c75-f364-421c-9e0e-8cbd98a70fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:49.439518 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-23024c75-f364-421c-9e0e-8cbd98a70fc6 None None] MFA Rules not processed for user `820e7098b5fc456da790361acd082164`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:49.440718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-23024c75-f364-421c-9e0e-8cbd98a70fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:49.505206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:49.538591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 675/1330] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:49.578745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dca5f-cb1a-436c-b340-1fe606317cef None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:49.580347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c75dca5f-cb1a-436c-b340-1fe606317cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:49.694521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75dca5f-cb1a-436c-b340-1fe606317cef None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:49.719486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:49.775920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b9e48c-56c6-445b-a210-1157b96cd2f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:49.776565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9e48c-56c6-445b-a210-1157b96cd2f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:49.776845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9e48c-56c6-445b-a210-1157b96cd2f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:49.777174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b9e48c-56c6-445b-a210-1157b96cd2f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:49.779406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-54b9e48c-56c6-445b-a210-1157b96cd2f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:49.894882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9e48c-56c6-445b-a210-1157b96cd2f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:49.896319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b9e48c-56c6-445b-a210-1157b96cd2f5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:49.915078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 656/1331] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:52.581244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2ef1-b8de-486a-9480-9135dfddd1c0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:52.581762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2ef1-b8de-486a-9480-9135dfddd1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:52.581762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db2ef1-b8de-486a-9480-9135dfddd1c0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:52.583116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 676/1332] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:52.588252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd35a9-5bc0-4229-981d-5e302f5063f5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:52.588631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd35a9-5bc0-4229-981d-5e302f5063f5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:52.588808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd35a9-5bc0-4229-981d-5e302f5063f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:52.650405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:52.653186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-35cd35a9-5bc0-4229-981d-5e302f5063f5 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:52.654403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-35cd35a9-5bc0-4229-981d-5e302f5063f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:52.750030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 657/1333] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:52.786889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db2ef1-b8de-486a-9480-9135dfddd1c0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:52.788496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-30db2ef1-b8de-486a-9480-9135dfddd1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:52.894602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db2ef1-b8de-486a-9480-9135dfddd1c0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:52.969757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51201cf8-7095-4c48-989b-8a7b23138fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:52.970411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51201cf8-7095-4c48-989b-8a7b23138fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:52.970698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51201cf8-7095-4c48-989b-8a7b23138fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:52.970978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51201cf8-7095-4c48-989b-8a7b23138fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:52.972621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51201cf8-7095-4c48-989b-8a7b23138fc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:53.000454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:53.083379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51201cf8-7095-4c48-989b-8a7b23138fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:53.084816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51201cf8-7095-4c48-989b-8a7b23138fc2 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:53.103029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 677/1334] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:55.201933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046cbca-7fce-4c85-9a6c-950a287d3901 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:55.202508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046cbca-7fce-4c85-9a6c-950a287d3901 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:55.202508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046cbca-7fce-4c85-9a6c-950a287d3901 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:55.203891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 658/1335] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:55.209131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad272-268f-44b4-a3a8-acb23407f4be None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:55.209544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad272-268f-44b4-a3a8-acb23407f4be None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:55.209697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ad272-268f-44b4-a3a8-acb23407f4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:55.274984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d39ad272-268f-44b4-a3a8-acb23407f4be None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:55.276180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d39ad272-268f-44b4-a3a8-acb23407f4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:55.352190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:55.375937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 678/1336] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:55.417660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046cbca-7fce-4c85-9a6c-950a287d3901 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:55.419353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0046cbca-7fce-4c85-9a6c-950a287d3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:55.520389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046cbca-7fce-4c85-9a6c-950a287d3901 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:55.547697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:55.592489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850c2c9-23d0-4d6f-b0a0-bf54a25ef703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:55.593157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850c2c9-23d0-4d6f-b0a0-bf54a25ef703 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:55.593440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850c2c9-23d0-4d6f-b0a0-bf54a25ef703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:55.593716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850c2c9-23d0-4d6f-b0a0-bf54a25ef703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:55.595361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f850c2c9-23d0-4d6f-b0a0-bf54a25ef703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:55.709265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850c2c9-23d0-4d6f-b0a0-bf54a25ef703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:55.709265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850c2c9-23d0-4d6f-b0a0-bf54a25ef703 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:55.725944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 659/1337] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:15:58.447037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bb54-7450-4e61-9f49-d4920316008d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:58.447571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bb54-7450-4e61-9f49-d4920316008d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:58.447571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c824bb54-7450-4e61-9f49-d4920316008d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:58.449162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 679/1338] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:15:58.454719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa8537-2757-4d70-a0ce-fad88bb552d6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:58.455195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa8537-2757-4d70-a0ce-fad88bb552d6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:58.455314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa8537-2757-4d70-a0ce-fad88bb552d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:58.519733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-42fa8537-2757-4d70-a0ce-fad88bb552d6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:15:58.520933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-42fa8537-2757-4d70-a0ce-fad88bb552d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:58.529910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:58.617611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 660/1339] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:15:58 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:15:58.653863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bb54-7450-4e61-9f49-d4920316008d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:15:58.655579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c824bb54-7450-4e61-9f49-d4920316008d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:58.757502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c824bb54-7450-4e61-9f49-d4920316008d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:15:58.829004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c307a5-da4e-4caf-aa2e-eb96718d1359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:15:58.829646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c307a5-da4e-4caf-aa2e-eb96718d1359 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:15:58.829961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c307a5-da4e-4caf-aa2e-eb96718d1359 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:15:58.830234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c307a5-da4e-4caf-aa2e-eb96718d1359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:15:58.831853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-11c307a5-da4e-4caf-aa2e-eb96718d1359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:15:58.866836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:15:58.939308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c307a5-da4e-4caf-aa2e-eb96718d1359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:15:58.940755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c307a5-da4e-4caf-aa2e-eb96718d1359 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:15:58.959399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 680/1340] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:15:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:03.400827 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd0a3-5346-4fd3-8475-d4c6019a78e4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:03.401401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd0a3-5346-4fd3-8475-d4c6019a78e4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:03.401401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dd0a3-5346-4fd3-8475-d4c6019a78e4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:03.403666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 661/1341] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:03.409275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecbd6a-b8aa-4db8-b394-57d2fdb18a24 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:03.409719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecbd6a-b8aa-4db8-b394-57d2fdb18a24 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:03.409810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cecbd6a-b8aa-4db8-b394-57d2fdb18a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:03.484724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7cecbd6a-b8aa-4db8-b394-57d2fdb18a24 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:03.485979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7cecbd6a-b8aa-4db8-b394-57d2fdb18a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:03.580708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:03.597453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 681/1342] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:03.633972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dd0a3-5346-4fd3-8475-d4c6019a78e4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:03.635771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ef1dd0a3-5346-4fd3-8475-d4c6019a78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:03.741697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1dd0a3-5346-4fd3-8475-d4c6019a78e4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:03.779960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:03.816600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037490e-8eb9-4eee-a455-85560a1fddd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:03.817279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037490e-8eb9-4eee-a455-85560a1fddd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:03.817562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037490e-8eb9-4eee-a455-85560a1fddd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:03.817837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037490e-8eb9-4eee-a455-85560a1fddd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:03.819469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b037490e-8eb9-4eee-a455-85560a1fddd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:03.930281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037490e-8eb9-4eee-a455-85560a1fddd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:03.931712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b037490e-8eb9-4eee-a455-85560a1fddd3 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:03.952353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 662/1343] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:07.111895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738598f8-00d6-47cc-a926-81fedf7c9ca9 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:07.112429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738598f8-00d6-47cc-a926-81fedf7c9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:07.112542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738598f8-00d6-47cc-a926-81fedf7c9ca9 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:07.113878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 682/1344] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:07.119096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe3da-9666-4886-9d18-a97d277d69a3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:07.119527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe3da-9666-4886-9d18-a97d277d69a3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:07.119777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2fe3da-9666-4886-9d18-a97d277d69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:07.186683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ae2fe3da-9666-4886-9d18-a97d277d69a3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:07.187796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ae2fe3da-9666-4886-9d18-a97d277d69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:07.207474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:07.285039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 663/1345] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:16:07.322967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738598f8-00d6-47cc-a926-81fedf7c9ca9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:07.325108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-738598f8-00d6-47cc-a926-81fedf7c9ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:07.431689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738598f8-00d6-47cc-a926-81fedf7c9ca9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:07.507101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5258ace-aa12-4210-b97b-8324fc3380cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:07.507667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5258ace-aa12-4210-b97b-8324fc3380cd service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:07.507958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5258ace-aa12-4210-b97b-8324fc3380cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:07.508235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5258ace-aa12-4210-b97b-8324fc3380cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:07.509919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d5258ace-aa12-4210-b97b-8324fc3380cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:07.557847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:07.643838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5258ace-aa12-4210-b97b-8324fc3380cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:07.645322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5258ace-aa12-4210-b97b-8324fc3380cd service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:07.665211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 683/1346] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:11.959101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f74a83-fa13-47c0-b0ba-613d5c2ae598 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:11.959101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f74a83-fa13-47c0-b0ba-613d5c2ae598 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:11.959673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f74a83-fa13-47c0-b0ba-613d5c2ae598 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:11.962408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 664/1347] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:16:11.966787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da989914-7a90-4c1b-907d-b983652e6886 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:11.967294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da989914-7a90-4c1b-907d-b983652e6886 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:11.967375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da989914-7a90-4c1b-907d-b983652e6886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:12.042755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-da989914-7a90-4c1b-907d-b983652e6886 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:12.044604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-da989914-7a90-4c1b-907d-b983652e6886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:12.153581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:12.156060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 684/1348] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:12.196230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f74a83-fa13-47c0-b0ba-613d5c2ae598 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:12.197884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82f74a83-fa13-47c0-b0ba-613d5c2ae598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:12.323563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f74a83-fa13-47c0-b0ba-613d5c2ae598 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:12.375602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:12.403470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f021bc-e27a-47f4-81a3-ce66397fd0f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:12.404139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f021bc-e27a-47f4-81a3-ce66397fd0f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:12.404454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f021bc-e27a-47f4-81a3-ce66397fd0f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:12.404731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f021bc-e27a-47f4-81a3-ce66397fd0f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:12.406488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-95f021bc-e27a-47f4-81a3-ce66397fd0f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:12.529209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f021bc-e27a-47f4-81a3-ce66397fd0f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:12.530655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f021bc-e27a-47f4-81a3-ce66397fd0f5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:12.551392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 665/1349] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:17.502981 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482f6f1-e17b-4964-a1c4-7c148c167bcf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:17.503508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482f6f1-e17b-4964-a1c4-7c148c167bcf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:17.503508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482f6f1-e17b-4964-a1c4-7c148c167bcf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:17.505179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 685/1350] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:17.513933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac28d8-3ef1-49d6-b6b7-798f4bdb0981 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:17.514389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac28d8-3ef1-49d6-b6b7-798f4bdb0981 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:17.514708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac28d8-3ef1-49d6-b6b7-798f4bdb0981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:17.640497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-88ac28d8-3ef1-49d6-b6b7-798f4bdb0981 None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:17.642138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-88ac28d8-3ef1-49d6-b6b7-798f4bdb0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:17.666639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:17.789667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 666/1351] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:16:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:21.935816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5df9-b762-41f0-90f0-fab9478cbffa None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:21.936391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5df9-b762-41f0-90f0-fab9478cbffa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:21.936714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d5df9-b762-41f0-90f0-fab9478cbffa None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:21.938384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 686/1352] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:16:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:21.944030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8cf4-9394-4dc3-9592-9e4ac351eda1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:21.944459 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8cf4-9394-4dc3-9592-9e4ac351eda1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:21.944835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a8cf4-9394-4dc3-9592-9e4ac351eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:22.026198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c64a8cf4-9394-4dc3-9592-9e4ac351eda1 None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:22.027745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c64a8cf4-9394-4dc3-9592-9e4ac351eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:22.107256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:22.144704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 667/1353] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:16:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:23.558939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8837-e5ea-4839-a941-721c322b5b36 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:23.559722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8837-e5ea-4839-a941-721c322b5b36 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:23.559722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e8837-e5ea-4839-a941-721c322b5b36 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:23.561120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 687/1354] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:23.566781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c84f-35de-4c42-ba08-e627bfbd66fa None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:23.567234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c84f-35de-4c42-ba08-e627bfbd66fa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:23.567374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c84f-35de-4c42-ba08-e627bfbd66fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:23.645495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-da21c84f-35de-4c42-ba08-e627bfbd66fa None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:23.646718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-da21c84f-35de-4c42-ba08-e627bfbd66fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:23.755589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 668/1355] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:16:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:27.199258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f903cb-57a9-42ec-b182-2ba33fc662cd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:27.200134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f903cb-57a9-42ec-b182-2ba33fc662cd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:27.200414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f903cb-57a9-42ec-b182-2ba33fc662cd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:27.206180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 688/1356] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:27.208302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8649f-1802-4402-acd8-25e46ef5567f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:27.209169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8649f-1802-4402-acd8-25e46ef5567f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:27.209662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8649f-1802-4402-acd8-25e46ef5567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:27.251142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:27.288213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7bc8649f-1802-4402-acd8-25e46ef5567f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:27.290255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7bc8649f-1802-4402-acd8-25e46ef5567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:27.406157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 669/1357] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:27.463592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8363-9913-4c7e-b575-dd7511b59436 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:27.463885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8363-9913-4c7e-b575-dd7511b59436 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:27.464451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98a8363-9913-4c7e-b575-dd7511b59436 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:27.466210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 689/1358] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 18 06:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:27.472383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6122-5fed-440d-abb6-36f19e619db3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:27.472764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6122-5fed-440d-abb6-36f19e619db3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:27.473366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c6122-5fed-440d-abb6-36f19e619db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:27.562007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-335c6122-5fed-440d-abb6-36f19e619db3 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:27.563083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-335c6122-5fed-440d-abb6-36f19e619db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:27.618660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:27.697259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 670/1359] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 18 06:16:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:27.701481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8363-9913-4c7e-b575-dd7511b59436 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:27.703132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c98a8363-9913-4c7e-b575-dd7511b59436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:27.864465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98a8363-9913-4c7e-b575-dd7511b59436 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:27.943325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:27.994751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f9dfb-79f6-4a08-82d5-69c7050ad616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:27.996704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9dfb-79f6-4a08-82d5-69c7050ad616 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:27.997221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9dfb-79f6-4a08-82d5-69c7050ad616 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:27.997698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9dfb-79f6-4a08-82d5-69c7050ad616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:27.999556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5d5f9dfb-79f6-4a08-82d5-69c7050ad616 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:28.101246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f9dfb-79f6-4a08-82d5-69c7050ad616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:28.102852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f9dfb-79f6-4a08-82d5-69c7050ad616 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:28.126834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 690/1360] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:30.387724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177fc35-d379-42fe-89df-c30f6d3dc52f None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:30.388298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177fc35-d379-42fe-89df-c30f6d3dc52f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:30.388298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177fc35-d379-42fe-89df-c30f6d3dc52f None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:30.389644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 671/1361] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:30.395105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669f8c-15d2-49c8-bc87-f705e6800316 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:30.395511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669f8c-15d2-49c8-bc87-f705e6800316 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:30.395665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56669f8c-15d2-49c8-bc87-f705e6800316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:30.466452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-56669f8c-15d2-49c8-bc87-f705e6800316 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:30.467607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-56669f8c-15d2-49c8-bc87-f705e6800316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:30.508546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:30.592491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 691/1362] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:30.635182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177fc35-d379-42fe-89df-c30f6d3dc52f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:30.637297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f177fc35-d379-42fe-89df-c30f6d3dc52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:30.817437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177fc35-d379-42fe-89df-c30f6d3dc52f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:30.828747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:30.982467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac03c737-4da9-46ae-9e9f-36025045e8f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:30.982467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03c737-4da9-46ae-9e9f-36025045e8f3 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:30.982467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03c737-4da9-46ae-9e9f-36025045e8f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:30.982467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac03c737-4da9-46ae-9e9f-36025045e8f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:30.982946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ac03c737-4da9-46ae-9e9f-36025045e8f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:31.083637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03c737-4da9-46ae-9e9f-36025045e8f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:31.085250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac03c737-4da9-46ae-9e9f-36025045e8f3 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:31.105646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 672/1363] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:33.669862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e67f-8ecf-445c-aa6a-d672f7eb6f9f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:33.670412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e67f-8ecf-445c-aa6a-d672f7eb6f9f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:33.670723 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310e67f-8ecf-445c-aa6a-d672f7eb6f9f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:33.672265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 692/1364] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:33.678061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5206d1-0128-4acf-8fdf-b05688b4313b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:33.678899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5206d1-0128-4acf-8fdf-b05688b4313b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:33.679185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5206d1-0128-4acf-8fdf-b05688b4313b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:33.696133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:33.763486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1f5206d1-0128-4acf-8fdf-b05688b4313b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:33.764696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1f5206d1-0128-4acf-8fdf-b05688b4313b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:33.878593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 673/1365] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:33.926890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3918d4-a8ee-4379-9b2c-a61468c8c8b2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:33.927081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3918d4-a8ee-4379-9b2c-a61468c8c8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:33.927368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3918d4-a8ee-4379-9b2c-a61468c8c8b2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:33.928945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 693/1366] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 18 06:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:33.935596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fedc6-b1a6-4202-9d7a-dfd76ee404b1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:33.935997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fedc6-b1a6-4202-9d7a-dfd76ee404b1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:33.937394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fedc6-b1a6-4202-9d7a-dfd76ee404b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:34.027036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-415fedc6-b1a6-4202-9d7a-dfd76ee404b1 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:34.028366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-415fedc6-b1a6-4202-9d7a-dfd76ee404b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:34.069751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:34.157543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 674/1367] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 18 06:16:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:34.165432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3918d4-a8ee-4379-9b2c-a61468c8c8b2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:34.166984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6f3918d4-a8ee-4379-9b2c-a61468c8c8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:34.338766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3918d4-a8ee-4379-9b2c-a61468c8c8b2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:34.363313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:34.470238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694ae8c-7072-4576-bfd9-ca977dd73477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:34.471105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694ae8c-7072-4576-bfd9-ca977dd73477 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:34.471501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694ae8c-7072-4576-bfd9-ca977dd73477 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:34.471888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694ae8c-7072-4576-bfd9-ca977dd73477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:34.473875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5694ae8c-7072-4576-bfd9-ca977dd73477 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:34.572390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694ae8c-7072-4576-bfd9-ca977dd73477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:34.574712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694ae8c-7072-4576-bfd9-ca977dd73477 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:34.594197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 694/1368] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:35.627260 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f260655-2cdc-4306-9297-df068d9f6570 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:35.627799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f260655-2cdc-4306-9297-df068d9f6570 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:35.627799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f260655-2cdc-4306-9297-df068d9f6570 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:35.629149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 675/1369] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:35.634520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018f1f-5e45-4906-98bd-e8dafcd3dbf7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:35.635027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018f1f-5e45-4906-98bd-e8dafcd3dbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:35.635121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c018f1f-5e45-4906-98bd-e8dafcd3dbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:35.668744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:35.709185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3c018f1f-5e45-4906-98bd-e8dafcd3dbf7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:35.710679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3c018f1f-5e45-4906-98bd-e8dafcd3dbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:35.820373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 695/1370] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:36.173046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca50d2-2ce3-40bd-addc-a940fed75adc None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:36.173424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca50d2-2ce3-40bd-addc-a940fed75adc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:36.173775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca50d2-2ce3-40bd-addc-a940fed75adc None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:36.175492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 676/1371] 10.222.0.27 () {54 vars in 964 bytes} [Mon Jul 18 06:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:36.180651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618796ba-e2e1-4e84-8c8d-b23e92495dae None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:36.181066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618796ba-e2e1-4e84-8c8d-b23e92495dae None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:36.181424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618796ba-e2e1-4e84-8c8d-b23e92495dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:36.281558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-618796ba-e2e1-4e84-8c8d-b23e92495dae None None] MFA Rules not processed for user `f44e152499fc494085c738c67d0397f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:36.283465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-618796ba-e2e1-4e84-8c8d-b23e92495dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:36.345453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:36.378354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 696/1372] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Jul 18 06:16:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:36.386899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca50d2-2ce3-40bd-addc-a940fed75adc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:36.389051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a5ca50d2-2ce3-40bd-addc-a940fed75adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:36.514966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca50d2-2ce3-40bd-addc-a940fed75adc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:36.568053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:36.611877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f813f6b-1517-4b16-827e-ca763ac5f209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:36.612584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f813f6b-1517-4b16-827e-ca763ac5f209 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:36.613262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f813f6b-1517-4b16-827e-ca763ac5f209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:36.613262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f813f6b-1517-4b16-827e-ca763ac5f209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:36.614977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7f813f6b-1517-4b16-827e-ca763ac5f209 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:36.750109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f813f6b-1517-4b16-827e-ca763ac5f209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:36.751610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f813f6b-1517-4b16-827e-ca763ac5f209 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:36.775011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 677/1373] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:36.860239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dcffb-8e68-4cc2-87b0-9fb8225263b1 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:36.860685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dcffb-8e68-4cc2-87b0-9fb8225263b1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:36.860914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dcffb-8e68-4cc2-87b0-9fb8225263b1 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:36.862396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 697/1374] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:36.867934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba9d9-0a2d-44ac-bfdd-e0ba66471cf3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:36.868152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba9d9-0a2d-44ac-bfdd-e0ba66471cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:36.868441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bba9d9-0a2d-44ac-bfdd-e0ba66471cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:36.944337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e9bba9d9-0a2d-44ac-bfdd-e0ba66471cf3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:36.945876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e9bba9d9-0a2d-44ac-bfdd-e0ba66471cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:36.970061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:37.077150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 678/1375] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:37.116102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dcffb-8e68-4cc2-87b0-9fb8225263b1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:37.118470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a19dcffb-8e68-4cc2-87b0-9fb8225263b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:37.295473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dcffb-8e68-4cc2-87b0-9fb8225263b1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:37.350309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:37.413241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba9923b-71f9-4c46-be19-963218769c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:37.413894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9923b-71f9-4c46-be19-963218769c1a service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:37.414178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9923b-71f9-4c46-be19-963218769c1a service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:37.414452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba9923b-71f9-4c46-be19-963218769c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:37.416121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cba9923b-71f9-4c46-be19-963218769c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:37.508800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9923b-71f9-4c46-be19-963218769c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:37.510453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba9923b-71f9-4c46-be19-963218769c1a service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:37.531890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 698/1376] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:39.758566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276b72-131d-495e-b414-29e167d35120 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:39.759157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276b72-131d-495e-b414-29e167d35120 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:39.759157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0276b72-131d-495e-b414-29e167d35120 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:39.760529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 679/1377] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:39.766055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca9b3-9f1b-4149-8127-bebf4fe7cd4c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:39.766516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca9b3-9f1b-4149-8127-bebf4fe7cd4c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:39.766618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ca9b3-9f1b-4149-8127-bebf4fe7cd4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:39.833497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-029ca9b3-9f1b-4149-8127-bebf4fe7cd4c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:39.834719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-029ca9b3-9f1b-4149-8127-bebf4fe7cd4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:39.842129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:39.945853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 699/1378] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:39.984926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0276b72-131d-495e-b414-29e167d35120 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:39.986721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f0276b72-131d-495e-b414-29e167d35120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:40.158757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0276b72-131d-495e-b414-29e167d35120 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:40.163247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:40.281808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314950b-bf0e-43ab-9ac0-c4e8c7102a2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:40.282703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314950b-bf0e-43ab-9ac0-c4e8c7102a2a service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:40.282991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314950b-bf0e-43ab-9ac0-c4e8c7102a2a service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:40.283263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314950b-bf0e-43ab-9ac0-c4e8c7102a2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:40.284907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a314950b-bf0e-43ab-9ac0-c4e8c7102a2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:40.381958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314950b-bf0e-43ab-9ac0-c4e8c7102a2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:40.383666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314950b-bf0e-43ab-9ac0-c4e8c7102a2a service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:40.411029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 680/1379] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:42.798001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172415d-db09-4dbc-8cad-77cad363cd17 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:42.798558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172415d-db09-4dbc-8cad-77cad363cd17 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:42.798558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172415d-db09-4dbc-8cad-77cad363cd17 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:42.800052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 700/1380] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:42.805348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0254a05-4700-4bb9-b6b6-7581f0c7d84b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:42.805829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0254a05-4700-4bb9-b6b6-7581f0c7d84b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:42.805940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0254a05-4700-4bb9-b6b6-7581f0c7d84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:42.817097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:42.879505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c0254a05-4700-4bb9-b6b6-7581f0c7d84b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:42.880748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c0254a05-4700-4bb9-b6b6-7581f0c7d84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:43.034714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 681/1381] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:43.086469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172415d-db09-4dbc-8cad-77cad363cd17 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:43.088101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7172415d-db09-4dbc-8cad-77cad363cd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:43.273532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:43.286262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172415d-db09-4dbc-8cad-77cad363cd17 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:43.427256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79ba79-ac00-4fa1-8009-0d7c3b0e00ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:43.427949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79ba79-ac00-4fa1-8009-0d7c3b0e00ad service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:43.428266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79ba79-ac00-4fa1-8009-0d7c3b0e00ad service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:43.428540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79ba79-ac00-4fa1-8009-0d7c3b0e00ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:43.430847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad79ba79-ac00-4fa1-8009-0d7c3b0e00ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:43.557145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79ba79-ac00-4fa1-8009-0d7c3b0e00ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:43.559470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79ba79-ac00-4fa1-8009-0d7c3b0e00ad service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:43.571614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:43.581414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 701/1382] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:45.902591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b30d-4549-47f7-ba00-1ee1704640a2 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:45.903429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b30d-4549-47f7-ba00-1ee1704640a2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:45.903429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c6b30d-4549-47f7-ba00-1ee1704640a2 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:45.905139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 682/1383] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:45.911317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc407-a49f-408b-a9e5-7f54dfc2ecbd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:45.912458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc407-a49f-408b-a9e5-7f54dfc2ecbd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:45.912458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1dc407-a49f-408b-a9e5-7f54dfc2ecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:46.005203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ef1dc407-a49f-408b-a9e5-7f54dfc2ecbd None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:46.007080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef1dc407-a49f-408b-a9e5-7f54dfc2ecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:46.118907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 702/1384] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:46.165096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b30d-4549-47f7-ba00-1ee1704640a2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:46.166705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-34c6b30d-4549-47f7-ba00-1ee1704640a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:46.272660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:46.370577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c6b30d-4549-47f7-ba00-1ee1704640a2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:46.504058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22265c-4e0b-4259-b262-bff49274e4fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:46.504653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22265c-4e0b-4259-b262-bff49274e4fd service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:46.504946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22265c-4e0b-4259-b262-bff49274e4fd service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:46.505263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22265c-4e0b-4259-b262-bff49274e4fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:46.506992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bb22265c-4e0b-4259-b262-bff49274e4fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:46.576140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:46.650379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22265c-4e0b-4259-b262-bff49274e4fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:46.652072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22265c-4e0b-4259-b262-bff49274e4fd service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:46.673065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 683/1385] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:49.271728 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908750e7-e973-412d-9a57-cb2c4b2f1963 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:49.272452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908750e7-e973-412d-9a57-cb2c4b2f1963 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:49.272452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908750e7-e973-412d-9a57-cb2c4b2f1963 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:49.273751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 703/1386] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:49.280305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455880d-bd3c-4de8-b620-fd8fd3be9d61 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:49.280847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455880d-bd3c-4de8-b620-fd8fd3be9d61 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:49.280847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455880d-bd3c-4de8-b620-fd8fd3be9d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:49.362407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b455880d-bd3c-4de8-b620-fd8fd3be9d61 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:49.364092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b455880d-bd3c-4de8-b620-fd8fd3be9d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:49.511429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 684/1387] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:49.574746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908750e7-e973-412d-9a57-cb2c4b2f1963 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:49.576272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-908750e7-e973-412d-9a57-cb2c4b2f1963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:49.687477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:49.771821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908750e7-e973-412d-9a57-cb2c4b2f1963 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:49.929300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9f28-af3d-4a77-8755-b99c4bb2a6c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:49.930174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9f28-af3d-4a77-8755-b99c4bb2a6c2 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:49.930548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9f28-af3d-4a77-8755-b99c4bb2a6c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:49.930915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9f28-af3d-4a77-8755-b99c4bb2a6c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:49.933843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2cff9f28-af3d-4a77-8755-b99c4bb2a6c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:49.984044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:50.048286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9f28-af3d-4a77-8755-b99c4bb2a6c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:50.049981 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9f28-af3d-4a77-8755-b99c4bb2a6c2 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:50.077487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 704/1388] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:52.317658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb9e8-3751-4a55-815b-353866113583 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.318200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb9e8-3751-4a55-815b-353866113583 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.318200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000bb9e8-3751-4a55-815b-353866113583 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.319613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 685/1389] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:16:52.326299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.326751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.326972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.396599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:52.397828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:52.420366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b852e-5b17-41ed-a721-74515f68c46d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.420650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b852e-5b17-41ed-a721-74515f68c46d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.420926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b852e-5b17-41ed-a721-74515f68c46d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.422327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 686/1390] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:16:52.427574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60934e-3d8c-4300-93be-6c2cb3323418 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.427865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60934e-3d8c-4300-93be-6c2cb3323418 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.428146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60934e-3d8c-4300-93be-6c2cb3323418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.464476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:52.497101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2b60934e-3d8c-4300-93be-6c2cb3323418 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:52.498488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b60934e-3d8c-4300-93be-6c2cb3323418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:52.503309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 705/1391] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:52.550701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:52.551921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:52.566643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:52.602599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 687/1392] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:16:52.661826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3793257-296e-49f5-9576-df524c2e6d6b None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.662108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3793257-296e-49f5-9576-df524c2e6d6b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.662394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3793257-296e-49f5-9576-df524c2e6d6b None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.663915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 688/1393] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 18 06:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:16:52.670184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0311c-e3b3-4e1c-8f29-71fff98e146e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.670468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0311c-e3b3-4e1c-8f29-71fff98e146e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.670747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0311c-e3b3-4e1c-8f29-71fff98e146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.673580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c2fef-1294-4ae7-af20-e2406817d631 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:52.748720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5bd0311c-e3b3-4e1c-8f29-71fff98e146e None None] MFA Rules not processed for user `81aa1b5c138247b9b7e0d65fb12af27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:52.750309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5bd0311c-e3b3-4e1c-8f29-71fff98e146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:52.795230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bc426-633e-4b9a-aed3-56987da209e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:52.795889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc426-633e-4b9a-aed3-56987da209e4 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.796181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc426-633e-4b9a-aed3-56987da209e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.796455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bc426-633e-4b9a-aed3-56987da209e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.798198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-809bc426-633e-4b9a-aed3-56987da209e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:52.801841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:52.807570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:52.831987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 689/1394] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 18 06:16:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:16:52.840600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0311c-e3b3-4e1c-8f29-71fff98e146e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:52.848454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0311c-e3b3-4e1c-8f29-71fff98e146e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:52.893695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bc426-633e-4b9a-aed3-56987da209e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:52.895405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bc426-633e-4b9a-aed3-56987da209e4 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:52.916392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 706/1395] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:16:52.925532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4db5f-b5d7-438b-8c1f-c0ce83e0bc30 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:52.926193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4db5f-b5d7-438b-8c1f-c0ce83e0bc30 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:52.926479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4db5f-b5d7-438b-8c1f-c0ce83e0bc30 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:52.926757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4db5f-b5d7-438b-8c1f-c0ce83e0bc30 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:52.928425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-55f4db5f-b5d7-438b-8c1f-c0ce83e0bc30 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:53.044261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4db5f-b5d7-438b-8c1f-c0ce83e0bc30 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:53.047250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4db5f-b5d7-438b-8c1f-c0ce83e0bc30 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:53.060608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:53.065874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 690/1396] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:16:53.926551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0faf0-c773-4bc1-9d0a-c36f6275923d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:53.926551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0faf0-c773-4bc1-9d0a-c36f6275923d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:53.927421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0faf0-c773-4bc1-9d0a-c36f6275923d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:54.004907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e5b0faf0-c773-4bc1-9d0a-c36f6275923d None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:54.006350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e5b0faf0-c773-4bc1-9d0a-c36f6275923d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:54.092220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:54.095758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 707/1397] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:16:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:54.139397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296dcb-9e21-4077-af93-ffe956217e31 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:54.139910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296dcb-9e21-4077-af93-ffe956217e31 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:54.140333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296dcb-9e21-4077-af93-ffe956217e31 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:54.142305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 691/1398] 10.222.0.27 () {54 vars in 943 bytes} [Mon Jul 18 06:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:54.152031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8806-cacb-42a4-92df-f7bc0fb0db1f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:54.152507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8806-cacb-42a4-92df-f7bc0fb0db1f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:54.152911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e8806-cacb-42a4-92df-f7bc0fb0db1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:54.250868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8d0e8806-cacb-42a4-92df-f7bc0fb0db1f None None] MFA Rules not processed for user `77c35cc610c74f66bc2625dd37dcefe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:54.252029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8d0e8806-cacb-42a4-92df-f7bc0fb0db1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:54.383018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 708/1399] 10.222.0.27 () {58 vars in 1040 bytes} [Mon Jul 18 06:16:54 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:54.394479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296dcb-9e21-4077-af93-ffe956217e31 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:54.396587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-80296dcb-9e21-4077-af93-ffe956217e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:54.553245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296dcb-9e21-4077-af93-ffe956217e31 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:54.646926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:54.670573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b2f49-b710-4ce6-a1f4-ce961be7334f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:54.671232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2f49-b710-4ce6-a1f4-ce961be7334f service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:54.671514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2f49-b710-4ce6-a1f4-ce961be7334f service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:54.671790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2f49-b710-4ce6-a1f4-ce961be7334f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:54.674036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2f2b2f49-b710-4ce6-a1f4-ce961be7334f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:54.772284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b2f49-b710-4ce6-a1f4-ce961be7334f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:54.773937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b2f49-b710-4ce6-a1f4-ce961be7334f service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:54.783569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 692/1400] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:16:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:16:55.179683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b652e3-1051-4e10-b589-581f17221f66 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:55.180274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b652e3-1051-4e10-b589-581f17221f66 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:55.180402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b652e3-1051-4e10-b589-581f17221f66 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:55.183906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 709/1401] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:16:55.190297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001dd07-c057-42ea-bbf8-1802c5d6f572 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:55.195025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001dd07-c057-42ea-bbf8-1802c5d6f572 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:55.195025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001dd07-c057-42ea-bbf8-1802c5d6f572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:55.271598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9001dd07-c057-42ea-bbf8-1802c5d6f572 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:55.272837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9001dd07-c057-42ea-bbf8-1802c5d6f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:55.352493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:55.388401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 693/1402] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:55.437259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b652e3-1051-4e10-b589-581f17221f66 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:55.438786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e9b652e3-1051-4e10-b589-581f17221f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:55.513269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:55.643618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b652e3-1051-4e10-b589-581f17221f66 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:55.784046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63400169-72d3-435d-944f-dddea01a316c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:55.785074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400169-72d3-435d-944f-dddea01a316c service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:55.785360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400169-72d3-435d-944f-dddea01a316c service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:55.785635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63400169-72d3-435d-944f-dddea01a316c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:55.787295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-63400169-72d3-435d-944f-dddea01a316c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:55.810839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:55.900362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63400169-72d3-435d-944f-dddea01a316c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:55.902026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63400169-72d3-435d-944f-dddea01a316c service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:55.928832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 710/1403] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:16:58.187768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c118c-6931-4d4e-8718-1a649f3b1f65 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:58.188427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c118c-6931-4d4e-8718-1a649f3b1f65 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:58.188427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c118c-6931-4d4e-8718-1a649f3b1f65 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:58.190631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 694/1404] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:16:58.199412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86ca62-bc83-4e28-b8bf-3e2f3e3d2c9a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:58.199412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86ca62-bc83-4e28-b8bf-3e2f3e3d2c9a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:58.199412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db86ca62-bc83-4e28-b8bf-3e2f3e3d2c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:58.293775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-db86ca62-bc83-4e28-b8bf-3e2f3e3d2c9a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:16:58.295111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-db86ca62-bc83-4e28-b8bf-3e2f3e3d2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:58.408515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:58.416681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 711/1405] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:16:58.464180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c118c-6931-4d4e-8718-1a649f3b1f65 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:16:58.467513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-917c118c-6931-4d4e-8718-1a649f3b1f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:58.655191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c118c-6931-4d4e-8718-1a649f3b1f65 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:16:58.734129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:16:58.806793 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f25fc1-3f3b-4bd5-9e02-1f9b1b705568 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:16:58.807991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25fc1-3f3b-4bd5-9e02-1f9b1b705568 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:16:58.808286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25fc1-3f3b-4bd5-9e02-1f9b1b705568 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:16:58.808559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f25fc1-3f3b-4bd5-9e02-1f9b1b705568 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:16:58.810297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-96f25fc1-3f3b-4bd5-9e02-1f9b1b705568 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:16:58.919971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f25fc1-3f3b-4bd5-9e02-1f9b1b705568 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:16:58.921645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f25fc1-3f3b-4bd5-9e02-1f9b1b705568 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:16:58.945114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 695/1406] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:01.220329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db1bc-5b88-41fa-b534-6585fc2b8e7d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:01.220927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db1bc-5b88-41fa-b534-6585fc2b8e7d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:01.220927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232db1bc-5b88-41fa-b534-6585fc2b8e7d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:01.222403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 712/1407] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:01.228386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20443-35aa-4561-ba92-c68ccaa07155 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:01.229858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20443-35aa-4561-ba92-c68ccaa07155 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:01.229858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd20443-35aa-4561-ba92-c68ccaa07155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:01.328723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cfd20443-35aa-4561-ba92-c68ccaa07155 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:01.330017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cfd20443-35aa-4561-ba92-c68ccaa07155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:01.348210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:01.476961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 696/1408] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:01.522775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db1bc-5b88-41fa-b534-6585fc2b8e7d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:01.524943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-232db1bc-5b88-41fa-b534-6585fc2b8e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:01.706763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232db1bc-5b88-41fa-b534-6585fc2b8e7d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:01.789715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:01.845618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d0ec7-04f0-4e79-b4a8-34872d801f73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:01.848430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0ec7-04f0-4e79-b4a8-34872d801f73 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:01.849366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0ec7-04f0-4e79-b4a8-34872d801f73 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:01.849366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d0ec7-04f0-4e79-b4a8-34872d801f73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:01.851069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0b6d0ec7-04f0-4e79-b4a8-34872d801f73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:01.970368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d0ec7-04f0-4e79-b4a8-34872d801f73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:01.971972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d0ec7-04f0-4e79-b4a8-34872d801f73 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:01.995708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 713/1409] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:11.474776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=38 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:11.991889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=64 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:19.335754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bee2a-c6e2-4ead-931c-158cfac5a8d8 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:19.336357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bee2a-c6e2-4ead-931c-158cfac5a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:19.336357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bee2a-c6e2-4ead-931c-158cfac5a8d8 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:19.338696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 697/1410] 10.222.0.27 () {54 vars in 918 bytes} [Mon Jul 18 06:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:19.344444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b6a4-e192-43a9-8a56-b5e5b049d99d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:19.344937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b6a4-e192-43a9-8a56-b5e5b049d99d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:19.345095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2b6a4-e192-43a9-8a56-b5e5b049d99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:19.424967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9ef2b6a4-e192-43a9-8a56-b5e5b049d99d None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:19.426224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ef2b6a4-e192-43a9-8a56-b5e5b049d99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:19.540617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 714/1411] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 18 06:17:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:19.555678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391165-329a-42be-9354-c37983b99a1c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:19.555970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391165-329a-42be-9354-c37983b99a1c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:19.556741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52391165-329a-42be-9354-c37983b99a1c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:19.558178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 698/1412] 10.222.0.27 () {54 vars in 918 bytes} [Mon Jul 18 06:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:19.563331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0355a-4d51-4d2a-9fc9-7966619d0942 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:19.563688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0355a-4d51-4d2a-9fc9-7966619d0942 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:19.564017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0355a-4d51-4d2a-9fc9-7966619d0942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:19.642272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:19.645338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-18d0355a-4d51-4d2a-9fc9-7966619d0942 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:19.646572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-18d0355a-4d51-4d2a-9fc9-7966619d0942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:19.777814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 715/1413] 10.222.0.27 () {58 vars in 1015 bytes} [Mon Jul 18 06:17:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:22.367056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3bcaf-1f28-4404-b383-e42dfb067069 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:22.367628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3bcaf-1f28-4404-b383-e42dfb067069 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:22.367628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c3bcaf-1f28-4404-b383-e42dfb067069 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:22.369899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:22.376238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616694-3597-4428-84f2-bde6af12ea25 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:22.377120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616694-3597-4428-84f2-bde6af12ea25 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:22.377120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5616694-3597-4428-84f2-bde6af12ea25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:22.454128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a5616694-3597-4428-84f2-bde6af12ea25 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:22.455355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a5616694-3597-4428-84f2-bde6af12ea25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:22.520430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:22.573611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:17:22.618872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3bcaf-1f28-4404-b383-e42dfb067069 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:22.620475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-22c3bcaf-1f28-4404-b383-e42dfb067069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:22.793664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c3bcaf-1f28-4404-b383-e42dfb067069 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:22.870665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:22.913346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985c8bd-6443-41e7-b5c2-ad7ed7539631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:22.914010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c8bd-6443-41e7-b5c2-ad7ed7539631 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:22.914590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c8bd-6443-41e7-b5c2-ad7ed7539631 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:22.914875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985c8bd-6443-41e7-b5c2-ad7ed7539631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:22.916842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9985c8bd-6443-41e7-b5c2-ad7ed7539631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:23.011382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985c8bd-6443-41e7-b5c2-ad7ed7539631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:23.013072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9985c8bd-6443-41e7-b5c2-ad7ed7539631 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:23.033064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 700/1416] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:23.977111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc244f9-2da7-4d53-bbea-c9f1cdab72b3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:23.977746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc244f9-2da7-4d53-bbea-c9f1cdab72b3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:23.977746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc244f9-2da7-4d53-bbea-c9f1cdab72b3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:23.979080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:23.984712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac633-b28f-4d1b-8676-f87e58225ae9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:23.985349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac633-b28f-4d1b-8676-f87e58225ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:23.985349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1ac633-b28f-4d1b-8676-f87e58225ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:24.070514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ba1ac633-b28f-4d1b-8676-f87e58225ae9 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:24.072437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ba1ac633-b28f-4d1b-8676-f87e58225ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:24.102390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:24.182677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:24.424197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc244f9-2da7-4d53-bbea-c9f1cdab72b3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:24.425826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5dc244f9-2da7-4d53-bbea-c9f1cdab72b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:24.587761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc244f9-2da7-4d53-bbea-c9f1cdab72b3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:24.632129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:24.717785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf45a78-adf0-42ec-ab30-255cbcaa7550 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:24.718711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45a78-adf0-42ec-ab30-255cbcaa7550 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:24.719095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45a78-adf0-42ec-ab30-255cbcaa7550 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:24.719474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf45a78-adf0-42ec-ab30-255cbcaa7550 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:24.721439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2bf45a78-adf0-42ec-ab30-255cbcaa7550 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:24.823236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf45a78-adf0-42ec-ab30-255cbcaa7550 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:24.824867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf45a78-adf0-42ec-ab30-255cbcaa7550 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:24.845447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 718/1419] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:25.772804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220600a-8233-485f-9042-7938733c8036 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:25.773716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220600a-8233-485f-9042-7938733c8036 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:25.773716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220600a-8233-485f-9042-7938733c8036 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:25.775328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:17:25.781370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6f81-c81a-4069-9a4e-babc1d0dcfd4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:25.782350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6f81-c81a-4069-9a4e-babc1d0dcfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:25.782350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6f81-c81a-4069-9a4e-babc1d0dcfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:25.845711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:25.871132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e7fd6f81-c81a-4069-9a4e-babc1d0dcfd4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:25.872363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e7fd6f81-c81a-4069-9a4e-babc1d0dcfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:25.986219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:17:26.147946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220600a-8233-485f-9042-7938733c8036 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:26.150116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8220600a-8233-485f-9042-7938733c8036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:26.331921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220600a-8233-485f-9042-7938733c8036 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:26.346730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:26.472016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b263965-6007-4391-9da9-39a8ff84d01d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:26.472594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263965-6007-4391-9da9-39a8ff84d01d service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:26.472883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263965-6007-4391-9da9-39a8ff84d01d service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:26.473189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b263965-6007-4391-9da9-39a8ff84d01d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:26.474925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b263965-6007-4391-9da9-39a8ff84d01d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:26.572909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b263965-6007-4391-9da9-39a8ff84d01d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:26.574579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b263965-6007-4391-9da9-39a8ff84d01d service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:26.594156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 703/1422] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:27.506617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d0b5c-1b46-406d-ab4e-dc7060d879c0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:27.507345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d0b5c-1b46-406d-ab4e-dc7060d879c0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:27.507604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d0b5c-1b46-406d-ab4e-dc7060d879c0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:27.510050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:27.515706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3aea4-0421-4a4d-9e2b-33fd7ac8a79c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:27.516253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3aea4-0421-4a4d-9e2b-33fd7ac8a79c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:27.516253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3aea4-0421-4a4d-9e2b-33fd7ac8a79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:27.535833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:27.604003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-14c3aea4-0421-4a4d-9e2b-33fd7ac8a79c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:27.605456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-14c3aea4-0421-4a4d-9e2b-33fd7ac8a79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:27.710592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:27.866918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d0b5c-1b46-406d-ab4e-dc7060d879c0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:27.869115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f06d0b5c-1b46-406d-ab4e-dc7060d879c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:27.987486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:28.026951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d0b5c-1b46-406d-ab4e-dc7060d879c0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:28.147846 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4669ca-c94f-47ff-9231-cc02a43934f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:28.148506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4669ca-c94f-47ff-9231-cc02a43934f0 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:28.148794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4669ca-c94f-47ff-9231-cc02a43934f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:28.149106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4669ca-c94f-47ff-9231-cc02a43934f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:28.151672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4f4669ca-c94f-47ff-9231-cc02a43934f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:28.229579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:28.243213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4669ca-c94f-47ff-9231-cc02a43934f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:28.254585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4669ca-c94f-47ff-9231-cc02a43934f0 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:28.264159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 721/1425] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:29.154951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7391de-aa2a-4a9d-b500-882952ced59c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:29.155544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7391de-aa2a-4a9d-b500-882952ced59c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:29.155544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7391de-aa2a-4a9d-b500-882952ced59c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:29.157203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:29.162322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771439-807c-499d-bf24-d0c405764ab7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:29.162760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771439-807c-499d-bf24-d0c405764ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:29.162872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771439-807c-499d-bf24-d0c405764ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:29.248889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-55771439-807c-499d-bf24-d0c405764ab7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:29.250182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-55771439-807c-499d-bf24-d0c405764ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:29.354479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:17:29.509542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7391de-aa2a-4a9d-b500-882952ced59c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:29.511379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bc7391de-aa2a-4a9d-b500-882952ced59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:29.602767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:29.666760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7391de-aa2a-4a9d-b500-882952ced59c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:29.800364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f80a4c-6553-4ef7-859a-34bec2c169c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:29.800922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80a4c-6553-4ef7-859a-34bec2c169c5 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:29.801235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80a4c-6553-4ef7-859a-34bec2c169c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:29.801507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f80a4c-6553-4ef7-859a-34bec2c169c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:29.803139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a6f80a4c-6553-4ef7-859a-34bec2c169c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:29.854489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:29.896929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f80a4c-6553-4ef7-859a-34bec2c169c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:29.898671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f80a4c-6553-4ef7-859a-34bec2c169c5 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:29.921466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 706/1428] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:30.813567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411464e3-1510-4d18-9e0f-5652a6d2dcfc None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:30.814154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411464e3-1510-4d18-9e0f-5652a6d2dcfc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:30.814154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411464e3-1510-4d18-9e0f-5652a6d2dcfc None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:30.815570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:30.820490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bb216-5b07-4a55-856e-2cf9d07f6798 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:30.820901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bb216-5b07-4a55-856e-2cf9d07f6798 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:30.821088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737bb216-5b07-4a55-856e-2cf9d07f6798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:30.905307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-737bb216-5b07-4a55-856e-2cf9d07f6798 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:30.906848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-737bb216-5b07-4a55-856e-2cf9d07f6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:31.026491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:31.181676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411464e3-1510-4d18-9e0f-5652a6d2dcfc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:31.183244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-411464e3-1510-4d18-9e0f-5652a6d2dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:31.233223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:31.335423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411464e3-1510-4d18-9e0f-5652a6d2dcfc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:31.452920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efab935-0428-4a92-a13f-b5dafdfd3a19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:31.453604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab935-0428-4a92-a13f-b5dafdfd3a19 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:31.453887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab935-0428-4a92-a13f-b5dafdfd3a19 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:31.454166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efab935-0428-4a92-a13f-b5dafdfd3a19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:31.455832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6efab935-0428-4a92-a13f-b5dafdfd3a19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:31.463031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:31.550152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efab935-0428-4a92-a13f-b5dafdfd3a19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:31.551760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efab935-0428-4a92-a13f-b5dafdfd3a19 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:31.570151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 724/1431] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:32.485571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123d4fd-fcf6-4f0b-b6c1-feeed9ff67cb None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:32.486148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123d4fd-fcf6-4f0b-b6c1-feeed9ff67cb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:32.486148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123d4fd-fcf6-4f0b-b6c1-feeed9ff67cb None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:32.487573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:32.492939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ecbfe-6881-4666-8d0c-6517c9d95285 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:32.493617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ecbfe-6881-4666-8d0c-6517c9d95285 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:32.493617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ecbfe-6881-4666-8d0c-6517c9d95285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:32.569124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e51ecbfe-6881-4666-8d0c-6517c9d95285 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:32.570251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e51ecbfe-6881-4666-8d0c-6517c9d95285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:32.643013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:32.674826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:32.830240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123d4fd-fcf6-4f0b-b6c1-feeed9ff67cb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:32.831718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f123d4fd-fcf6-4f0b-b6c1-feeed9ff67cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:32.853714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:32.994668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123d4fd-fcf6-4f0b-b6c1-feeed9ff67cb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:33.085962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:33.112090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d3777-8b7c-4194-8dda-52eb85109ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:33.112746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d3777-8b7c-4194-8dda-52eb85109ce8 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:33.113054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d3777-8b7c-4194-8dda-52eb85109ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:33.113339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d3777-8b7c-4194-8dda-52eb85109ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:33.115042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7b7d3777-8b7c-4194-8dda-52eb85109ce8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:33.212944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d3777-8b7c-4194-8dda-52eb85109ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:33.214637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d3777-8b7c-4194-8dda-52eb85109ce8 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:33.234415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 709/1434] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:34.134954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6fcce-b5ee-4f54-b817-99d6e37d6fa7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:34.135546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6fcce-b5ee-4f54-b817-99d6e37d6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:34.135766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6fcce-b5ee-4f54-b817-99d6e37d6fa7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:34.137317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:34.142307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f32d9-8bd6-4fce-9dad-d2ea42846695 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:34.142762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f32d9-8bd6-4fce-9dad-d2ea42846695 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:34.142894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f32d9-8bd6-4fce-9dad-d2ea42846695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:34.218672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-009f32d9-8bd6-4fce-9dad-d2ea42846695 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:34.219821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-009f32d9-8bd6-4fce-9dad-d2ea42846695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:34.262006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:34.318652 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:34.471461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6fcce-b5ee-4f54-b817-99d6e37d6fa7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:34.472894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5bf6fcce-b5ee-4f54-b817-99d6e37d6fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:34.619599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6fcce-b5ee-4f54-b817-99d6e37d6fa7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:34.674475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:34.734572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2010f4-93bb-4e01-8665-6075ede0b513 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:34.735142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2010f4-93bb-4e01-8665-6075ede0b513 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:34.735418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2010f4-93bb-4e01-8665-6075ede0b513 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:34.735699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2010f4-93bb-4e01-8665-6075ede0b513 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:34.737410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4e2010f4-93bb-4e01-8665-6075ede0b513 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:34.829905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2010f4-93bb-4e01-8665-6075ede0b513 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:34.831565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2010f4-93bb-4e01-8665-6075ede0b513 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:34.850484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 727/1437] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:35.834768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15780e36-931f-4201-b531-2e2ef070a8e0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:35.835485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15780e36-931f-4201-b531-2e2ef070a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:35.835485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15780e36-931f-4201-b531-2e2ef070a8e0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:35.836829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:35.842946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ef59-e42f-4691-a9df-455c07730df2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:35.843488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ef59-e42f-4691-a9df-455c07730df2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:35.843488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2ef59-e42f-4691-a9df-455c07730df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:35.921616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fca2ef59-e42f-4691-a9df-455c07730df2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:35.922819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fca2ef59-e42f-4691-a9df-455c07730df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:35.925027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:36.024720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:17:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:36.176419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15780e36-931f-4201-b531-2e2ef070a8e0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:36.178244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-15780e36-931f-4201-b531-2e2ef070a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:36.335388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15780e36-931f-4201-b531-2e2ef070a8e0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:36.364534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:36.454802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45ad57-3812-4a11-a1da-2dab8eb3473f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:36.455375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ad57-3812-4a11-a1da-2dab8eb3473f service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:36.455656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ad57-3812-4a11-a1da-2dab8eb3473f service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:36.455934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45ad57-3812-4a11-a1da-2dab8eb3473f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:36.457613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7a45ad57-3812-4a11-a1da-2dab8eb3473f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:36.549472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ad57-3812-4a11-a1da-2dab8eb3473f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:36.551087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a45ad57-3812-4a11-a1da-2dab8eb3473f service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:36.569769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 712/1440] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:38.522559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0d6a4-353f-4f7d-9f14-5462001038e7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:38.523185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0d6a4-353f-4f7d-9f14-5462001038e7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:38.523185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0d6a4-353f-4f7d-9f14-5462001038e7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:38.525107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:38.530683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858d51-4d00-4418-932c-6d05b229c739 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:38.531151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858d51-4d00-4418-932c-6d05b229c739 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:38.531499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f858d51-4d00-4418-932c-6d05b229c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:38.572890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:38.600523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8f858d51-4d00-4418-932c-6d05b229c739 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:38.601801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8f858d51-4d00-4418-932c-6d05b229c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:38.708675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:17:38.747987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0d6a4-353f-4f7d-9f14-5462001038e7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:38.749629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bec0d6a4-353f-4f7d-9f14-5462001038e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:38.859671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0d6a4-353f-4f7d-9f14-5462001038e7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:39.012950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:39.059105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e656f0-901e-4fd8-9805-0933f4786134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:39.059764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e656f0-901e-4fd8-9805-0933f4786134 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:39.060049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e656f0-901e-4fd8-9805-0933f4786134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:39.060326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e656f0-901e-4fd8-9805-0933f4786134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:39.062062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-25e656f0-901e-4fd8-9805-0933f4786134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:39.176413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e656f0-901e-4fd8-9805-0933f4786134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:39.177902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e656f0-901e-4fd8-9805-0933f4786134 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:39.198134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 730/1443] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:41.484124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6d7f-4579-433c-96cf-ff3ca470fde4 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:41.484691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6d7f-4579-433c-96cf-ff3ca470fde4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:41.484691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb6d7f-4579-433c-96cf-ff3ca470fde4 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:41.486115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:41.491648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b78f7-c37c-475e-b057-719d0ddbdc82 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:41.492142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b78f7-c37c-475e-b057-719d0ddbdc82 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:41.492255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b78f7-c37c-475e-b057-719d0ddbdc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:41.570267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-574b78f7-c37c-475e-b057-719d0ddbdc82 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:41.571738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-574b78f7-c37c-475e-b057-719d0ddbdc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:41.586640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:41.688799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:41.733184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb6d7f-4579-433c-96cf-ff3ca470fde4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:41.734777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-96bb6d7f-4579-433c-96cf-ff3ca470fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:41.849005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb6d7f-4579-433c-96cf-ff3ca470fde4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:41.862807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:41.929966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1ac71-3ad2-44c2-8ed3-137298bc9850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:41.931189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1ac71-3ad2-44c2-8ed3-137298bc9850 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:41.931475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1ac71-3ad2-44c2-8ed3-137298bc9850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:41.932090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1ac71-3ad2-44c2-8ed3-137298bc9850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:41.933841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b8d1ac71-3ad2-44c2-8ed3-137298bc9850 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:42.055879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1ac71-3ad2-44c2-8ed3-137298bc9850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:42.057339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1ac71-3ad2-44c2-8ed3-137298bc9850 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:42.077687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 715/1446] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:17:44.644892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3be0-84a3-464a-850a-45b82c7c4fb7 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:44.645508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3be0-84a3-464a-850a-45b82c7c4fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:44.645508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc3be0-84a3-464a-850a-45b82c7c4fb7 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:44.646860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:44.652832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f6ec-1fe1-45c1-ab22-2322fe796342 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:44.653333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f6ec-1fe1-45c1-ab22-2322fe796342 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:44.653457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209f6ec-1fe1-45c1-ab22-2322fe796342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:44.706606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:44.726248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c209f6ec-1fe1-45c1-ab22-2322fe796342 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:44.728258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c209f6ec-1fe1-45c1-ab22-2322fe796342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:44.844742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:44.885990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc3be0-84a3-464a-850a-45b82c7c4fb7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:44.887623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-42bc3be0-84a3-464a-850a-45b82c7c4fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:44.999824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc3be0-84a3-464a-850a-45b82c7c4fb7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:45.046378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:45.084697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c36bf-d87a-4cb7-98fd-4eddb05be971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:45.085378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c36bf-d87a-4cb7-98fd-4eddb05be971 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:45.085657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c36bf-d87a-4cb7-98fd-4eddb05be971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:45.085929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c36bf-d87a-4cb7-98fd-4eddb05be971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:45.088658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a04c36bf-d87a-4cb7-98fd-4eddb05be971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:45.208039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c36bf-d87a-4cb7-98fd-4eddb05be971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:45.209598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c36bf-d87a-4cb7-98fd-4eddb05be971 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:45.231632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 733/1449] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:47.446613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a60dd-3fc9-4264-bbe4-002cc419095d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:47.447223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a60dd-3fc9-4264-bbe4-002cc419095d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:47.447464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a60dd-3fc9-4264-bbe4-002cc419095d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:47.448937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:47.455104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a123f5-60e0-4f75-a3ed-1eaac79a0155 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:47.456468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a123f5-60e0-4f75-a3ed-1eaac79a0155 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:47.456468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a123f5-60e0-4f75-a3ed-1eaac79a0155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:47.528821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-49a123f5-60e0-4f75-a3ed-1eaac79a0155 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:47.530074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-49a123f5-60e0-4f75-a3ed-1eaac79a0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:47.551221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:47.629142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:47.668791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a60dd-3fc9-4264-bbe4-002cc419095d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:47.670821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d59a60dd-3fc9-4264-bbe4-002cc419095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:47.776236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a60dd-3fc9-4264-bbe4-002cc419095d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:47.797062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:47.854253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98461c-a9bf-4a22-a558-ab38d1bf0edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:47.854905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98461c-a9bf-4a22-a558-ab38d1bf0edc service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:47.855193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98461c-a9bf-4a22-a558-ab38d1bf0edc service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:47.855463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98461c-a9bf-4a22-a558-ab38d1bf0edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:47.857219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ba98461c-a9bf-4a22-a558-ab38d1bf0edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:47.979914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98461c-a9bf-4a22-a558-ab38d1bf0edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:47.981405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98461c-a9bf-4a22-a558-ab38d1bf0edc service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:48.000373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 718/1452] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:50.115259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87d10-fad5-4246-9e80-56ba09214147 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:50.115805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87d10-fad5-4246-9e80-56ba09214147 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:50.115805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87d10-fad5-4246-9e80-56ba09214147 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:50.117222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:50.123293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b0976-f015-4b5f-8d34-a1ab14ad5d58 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:50.123709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b0976-f015-4b5f-8d34-a1ab14ad5d58 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:50.123866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b0976-f015-4b5f-8d34-a1ab14ad5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:50.187002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:50.189752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a21b0976-f015-4b5f-8d34-a1ab14ad5d58 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:50.190937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a21b0976-f015-4b5f-8d34-a1ab14ad5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:50.290376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:50.328057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87d10-fad5-4246-9e80-56ba09214147 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:50.329698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bdd87d10-fad5-4246-9e80-56ba09214147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:50.436718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87d10-fad5-4246-9e80-56ba09214147 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:50.486905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:50.513325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3081bc4-7d8b-405c-8040-b56e57cb342a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:50.513977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081bc4-7d8b-405c-8040-b56e57cb342a service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:50.514261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081bc4-7d8b-405c-8040-b56e57cb342a service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:50.514538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081bc4-7d8b-405c-8040-b56e57cb342a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:50.516202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3081bc4-7d8b-405c-8040-b56e57cb342a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:50.627912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3081bc4-7d8b-405c-8040-b56e57cb342a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:50.629379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3081bc4-7d8b-405c-8040-b56e57cb342a service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:50.647845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 736/1455] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:52.772902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634acf-ce70-407f-a337-c7cb41397703 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:52.773512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634acf-ce70-407f-a337-c7cb41397703 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:52.773512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00634acf-ce70-407f-a337-c7cb41397703 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:52.775722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:52.781732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2f23-dad6-4085-8425-b1d1395e937a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:52.782189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2f23-dad6-4085-8425-b1d1395e937a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:52.782298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e2f23-dad6-4085-8425-b1d1395e937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:52.850594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6b1e2f23-dad6-4085-8425-b1d1395e937a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:52.852524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6b1e2f23-dad6-4085-8425-b1d1395e937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:52.882708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:52.951970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:17:52.990789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00634acf-ce70-407f-a337-c7cb41397703 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:52.992433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-00634acf-ce70-407f-a337-c7cb41397703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:53.097904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00634acf-ce70-407f-a337-c7cb41397703 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:53.126630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:53.173097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8c0b7-4414-4b7c-b92f-34a27d77e2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:53.173761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8c0b7-4414-4b7c-b92f-34a27d77e2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:53.174042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8c0b7-4414-4b7c-b92f-34a27d77e2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:53.174315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8c0b7-4414-4b7c-b92f-34a27d77e2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:53.175972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-aec8c0b7-4414-4b7c-b92f-34a27d77e2eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:53.296658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8c0b7-4414-4b7c-b92f-34a27d77e2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:53.298077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8c0b7-4414-4b7c-b92f-34a27d77e2eb service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:53.318198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 721/1458] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:55.506003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13e66-32d4-4281-86f0-a35fcac10ce6 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:55.506596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13e66-32d4-4281-86f0-a35fcac10ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:55.506596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef13e66-32d4-4281-86f0-a35fcac10ce6 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:55.508545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:55.514305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d4fde-477f-431d-8bc6-0100d383fcc0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:55.514764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d4fde-477f-431d-8bc6-0100d383fcc0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:55.514871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708d4fde-477f-431d-8bc6-0100d383fcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:55.594434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-708d4fde-477f-431d-8bc6-0100d383fcc0 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:55.595568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-708d4fde-477f-431d-8bc6-0100d383fcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:55.604495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:55.694837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:55.733285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13e66-32d4-4281-86f0-a35fcac10ce6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:55.734812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bef13e66-32d4-4281-86f0-a35fcac10ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:55.841456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef13e66-32d4-4281-86f0-a35fcac10ce6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:55.900311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:55.919995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78cefa-4856-48a0-bc5b-1137094cb848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:55.920645 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78cefa-4856-48a0-bc5b-1137094cb848 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:55.920928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78cefa-4856-48a0-bc5b-1137094cb848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:55.926382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78cefa-4856-48a0-bc5b-1137094cb848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:55.926382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0e78cefa-4856-48a0-bc5b-1137094cb848 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:56.047756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78cefa-4856-48a0-bc5b-1137094cb848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:56.049247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78cefa-4856-48a0-bc5b-1137094cb848 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:56.072742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 739/1461] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:17:58.181191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb812-e498-4108-8025-0f589526d90a None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:58.181937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb812-e498-4108-8025-0f589526d90a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:58.181937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cb812-e498-4108-8025-0f589526d90a None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:58.183162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:17:58.188840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8a00b-005f-46fe-8766-b0c51b6e6e7d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:58.189329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8a00b-005f-46fe-8766-b0c51b6e6e7d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:58.189436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8a00b-005f-46fe-8766-b0c51b6e6e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:58.258777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e3f8a00b-005f-46fe-8766-b0c51b6e6e7d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:17:58.260139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e3f8a00b-005f-46fe-8766-b0c51b6e6e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:58.303687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:58.365983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:17:58.404550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cb812-e498-4108-8025-0f589526d90a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:17:58.406439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d06cb812-e498-4108-8025-0f589526d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:58.511825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cb812-e498-4108-8025-0f589526d90a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:17:58.555870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:17:58.608672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf44814-f32b-4bdd-ac7b-cc6452e525f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:17:58.609646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44814-f32b-4bdd-ac7b-cc6452e525f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:17:58.609934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44814-f32b-4bdd-ac7b-cc6452e525f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:17:58.610311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf44814-f32b-4bdd-ac7b-cc6452e525f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:17:58.613192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dbf44814-f32b-4bdd-ac7b-cc6452e525f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:17:58.740226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf44814-f32b-4bdd-ac7b-cc6452e525f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:17:58.741787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf44814-f32b-4bdd-ac7b-cc6452e525f7 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:17:58.775964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 724/1464] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:17:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:18:00.897114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1672e32-75ff-4151-87e5-6c7d7819c5f3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:00.897750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1672e32-75ff-4151-87e5-6c7d7819c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:00.897929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1672e32-75ff-4151-87e5-6c7d7819c5f3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:00.900199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:18:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:18:00.907091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafac876-f7c8-4b47-8cf4-e16a4b3a2f55 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:00.907676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafac876-f7c8-4b47-8cf4-e16a4b3a2f55 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:00.907676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafac876-f7c8-4b47-8cf4-e16a4b3a2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:00.984717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bafac876-f7c8-4b47-8cf4-e16a4b3a2f55 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:00.985958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bafac876-f7c8-4b47-8cf4-e16a4b3a2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:01.005678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:01.095170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:01.133695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1672e32-75ff-4151-87e5-6c7d7819c5f3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:01.135274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c1672e32-75ff-4151-87e5-6c7d7819c5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:01.241451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1672e32-75ff-4151-87e5-6c7d7819c5f3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:01.311411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:01.319209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c891a-65cc-4b9a-a703-c15e1c5a01f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:01.319861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c891a-65cc-4b9a-a703-c15e1c5a01f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:01.320674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c891a-65cc-4b9a-a703-c15e1c5a01f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:01.321152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c891a-65cc-4b9a-a703-c15e1c5a01f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:01.322867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-de4c891a-65cc-4b9a-a703-c15e1c5a01f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:01.441660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c891a-65cc-4b9a-a703-c15e1c5a01f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:01.443114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c891a-65cc-4b9a-a703-c15e1c5a01f1 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:01.463303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 742/1467] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:18:03.594627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1ed6c-4f84-492d-94a5-4aed24f313af None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:03.595181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1ed6c-4f84-492d-94a5-4aed24f313af None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:03.595181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1ed6c-4f84-492d-94a5-4aed24f313af None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:03.596542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:03.603296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035dd7c-2a41-4865-b48d-69cafa719716 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:03.603826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035dd7c-2a41-4865-b48d-69cafa719716 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:03.603826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035dd7c-2a41-4865-b48d-69cafa719716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:03.679201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f035dd7c-2a41-4865-b48d-69cafa719716 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:03.680961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f035dd7c-2a41-4865-b48d-69cafa719716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:03.737993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:03.794553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:03.833500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1ed6c-4f84-492d-94a5-4aed24f313af None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:03.835093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d9d1ed6c-4f84-492d-94a5-4aed24f313af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:03.948480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1ed6c-4f84-492d-94a5-4aed24f313af None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:04.008803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:04.036613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7454c7cd-171f-418e-96f7-4d3dbdfdf8b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:04.037303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c7cd-171f-418e-96f7-4d3dbdfdf8b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:04.037592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c7cd-171f-418e-96f7-4d3dbdfdf8b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:04.037866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7454c7cd-171f-418e-96f7-4d3dbdfdf8b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:04.040271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7454c7cd-171f-418e-96f7-4d3dbdfdf8b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:04.162230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454c7cd-171f-418e-96f7-4d3dbdfdf8b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:04.163686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7454c7cd-171f-418e-96f7-4d3dbdfdf8b7 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:04.187609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 727/1470] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:18:13.792058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=22 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:14.185078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=66 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:24.879814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea5c2-80ce-4527-98a8-d432ebc734e0 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:24.880631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea5c2-80ce-4527-98a8-d432ebc734e0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:24.880631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fea5c2-80ce-4527-98a8-d432ebc734e0 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:24.882017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 744/1471] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:24.888572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b171483-36b1-484f-88ea-d48cf25ec1fd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:24.889195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b171483-36b1-484f-88ea-d48cf25ec1fd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:24.889195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b171483-36b1-484f-88ea-d48cf25ec1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:24.961586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4b171483-36b1-484f-88ea-d48cf25ec1fd None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:24.962838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b171483-36b1-484f-88ea-d48cf25ec1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:25.069154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 728/1472] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:25.121223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd10b3-dbe9-448b-be84-352515a467d5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:25.121560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd10b3-dbe9-448b-be84-352515a467d5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:25.121882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd10b3-dbe9-448b-be84-352515a467d5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:25.123448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 745/1473] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 18 06:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:25.128750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2191-8d1d-468c-b6bd-b8a21db26e37 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:25.129133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2191-8d1d-468c-b6bd-b8a21db26e37 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:25.129551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2191-8d1d-468c-b6bd-b8a21db26e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:25.211822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-890e2191-8d1d-468c-b6bd-b8a21db26e37 None None] MFA Rules not processed for user `81aa1b5c138247b9b7e0d65fb12af27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:25.213111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-890e2191-8d1d-468c-b6bd-b8a21db26e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:25.235884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:25.298452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 729/1474] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 18 06:18:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:25.389035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd10b3-dbe9-448b-be84-352515a467d5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:25.389035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-41fd10b3-dbe9-448b-be84-352515a467d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:25.433926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd10b3-dbe9-448b-be84-352515a467d5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:25.512822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1fffb-cbdc-45bd-90d3-78751a1db46b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:25.513517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1fffb-cbdc-45bd-90d3-78751a1db46b service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:25.513847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1fffb-cbdc-45bd-90d3-78751a1db46b service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:25.514170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1fffb-cbdc-45bd-90d3-78751a1db46b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:25.516126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-48d1fffb-cbdc-45bd-90d3-78751a1db46b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:25.583311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:25.642750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1fffb-cbdc-45bd-90d3-78751a1db46b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:25.644238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1fffb-cbdc-45bd-90d3-78751a1db46b service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:25.666285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 746/1475] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:18:27.891228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6df51-098a-4856-be53-66cfee75daff None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:27.891968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6df51-098a-4856-be53-66cfee75daff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:27.891968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6df51-098a-4856-be53-66cfee75daff None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:27.894145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 730/1476] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:18:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:27.900526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811991-5183-42e8-a5a9-70b6368e200d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:27.901240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811991-5183-42e8-a5a9-70b6368e200d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:27.901240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811991-5183-42e8-a5a9-70b6368e200d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:27.986708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3e811991-5183-42e8-a5a9-70b6368e200d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:27.987990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e811991-5183-42e8-a5a9-70b6368e200d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:28.111297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 747/1477] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:28.135896 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6df51-098a-4856-be53-66cfee75daff None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:28.137502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d2b6df51-098a-4856-be53-66cfee75daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:28.285235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6df51-098a-4856-be53-66cfee75daff None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:28.341000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:28.392259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4728bad7-0ca6-486d-9520-292567c32671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:28.392929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728bad7-0ca6-486d-9520-292567c32671 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:28.393231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728bad7-0ca6-486d-9520-292567c32671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:28.393507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4728bad7-0ca6-486d-9520-292567c32671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:28.394243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728bad7-0ca6-486d-9520-292567c32671 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:28.396146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-4728bad7-0ca6-486d-9520-292567c32671 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:18:28.396146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:18:28.396146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:18:28.397357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4728bad7-0ca6-486d-9520-292567c32671 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:28.419669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 731/1478] 10.222.0.27 () {56 vars in 1108 bytes} [Mon Jul 18 06:18:28 2022] GET /identity/v3/projects => generated 2553 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:18:30.521485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f048-9fb0-418e-a413-91b327e2c68c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:30.522961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f048-9fb0-418e-a413-91b327e2c68c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:30.522961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba0f048-9fb0-418e-a413-91b327e2c68c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:30.524168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 748/1479] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:30.530207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757d6f-7126-41c0-9edd-4d90c8e29178 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:30.530978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757d6f-7126-41c0-9edd-4d90c8e29178 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:30.531103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61757d6f-7126-41c0-9edd-4d90c8e29178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:30.621653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-61757d6f-7126-41c0-9edd-4d90c8e29178 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:30.622840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-61757d6f-7126-41c0-9edd-4d90c8e29178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:30.735835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 732/1480] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:18:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:30.784376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0f048-9fb0-418e-a413-91b327e2c68c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:30.786016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9ba0f048-9fb0-418e-a413-91b327e2c68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:30.800819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:30.983816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba0f048-9fb0-418e-a413-91b327e2c68c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:31.073942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:31.110753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e588370-1fdf-48c8-810e-0e84f530668f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:31.111467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588370-1fdf-48c8-810e-0e84f530668f service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:31.111779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588370-1fdf-48c8-810e-0e84f530668f service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:31.112092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e588370-1fdf-48c8-810e-0e84f530668f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:31.113855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7e588370-1fdf-48c8-810e-0e84f530668f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:31.211993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e588370-1fdf-48c8-810e-0e84f530668f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:31.213649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e588370-1fdf-48c8-810e-0e84f530668f service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:31.233564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 749/1481] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:18:33.521486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bfbd9-c6e1-4cf6-8f6a-565239e4167d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:33.522101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bfbd9-c6e1-4cf6-8f6a-565239e4167d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:33.522101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909bfbd9-c6e1-4cf6-8f6a-565239e4167d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:33.523691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 733/1482] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:18:33.530024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919303-8d37-463d-abff-0e6be7e1de7b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:33.530024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919303-8d37-463d-abff-0e6be7e1de7b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:33.536319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e919303-8d37-463d-abff-0e6be7e1de7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:33.608120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7e919303-8d37-463d-abff-0e6be7e1de7b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:33.609273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7e919303-8d37-463d-abff-0e6be7e1de7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:33.659155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:33.717464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 750/1483] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:18:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:33.755151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bfbd9-c6e1-4cf6-8f6a-565239e4167d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:33.756704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-909bfbd9-c6e1-4cf6-8f6a-565239e4167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:33.782785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:33.871556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909bfbd9-c6e1-4cf6-8f6a-565239e4167d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:33.948647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c54259-f90b-43f8-81d4-1313d6d3d37e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:33.949335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54259-f90b-43f8-81d4-1313d6d3d37e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:33.949625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54259-f90b-43f8-81d4-1313d6d3d37e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:33.949906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c54259-f90b-43f8-81d4-1313d6d3d37e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:33.951780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94c54259-f90b-43f8-81d4-1313d6d3d37e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:34.035015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:34.073441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c54259-f90b-43f8-81d4-1313d6d3d37e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:34.074882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c54259-f90b-43f8-81d4-1313d6d3d37e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:34.094717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 734/1484] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:18:36.231929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea566-1bc9-48a7-bc3a-f683deb7f02f None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:36.232462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea566-1bc9-48a7-bc3a-f683deb7f02f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:36.232462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea566-1bc9-48a7-bc3a-f683deb7f02f None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:36.233828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 751/1485] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:36.239176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d6a65-85a5-4d22-9f4a-c12a842eb6f7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:36.239633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d6a65-85a5-4d22-9f4a-c12a842eb6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:36.239742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d6a65-85a5-4d22-9f4a-c12a842eb6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:36.429414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f24d6a65-85a5-4d22-9f4a-c12a842eb6f7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:36.430651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f24d6a65-85a5-4d22-9f4a-c12a842eb6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:36.537567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 735/1486] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:36.581266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea566-1bc9-48a7-bc3a-f683deb7f02f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:36.582975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8b8ea566-1bc9-48a7-bc3a-f683deb7f02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:36.724643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea566-1bc9-48a7-bc3a-f683deb7f02f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:36.855541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:36.858608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64add8-74e8-4044-b0f2-2c54c4f85b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:36.859710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64add8-74e8-4044-b0f2-2c54c4f85b20 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:36.860207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64add8-74e8-4044-b0f2-2c54c4f85b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:36.860694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64add8-74e8-4044-b0f2-2c54c4f85b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:36.863901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e64add8-74e8-4044-b0f2-2c54c4f85b20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:37.059720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64add8-74e8-4044-b0f2-2c54c4f85b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:37.062622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64add8-74e8-4044-b0f2-2c54c4f85b20 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:37.096851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 752/1487] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:18:39.386230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9430-63f2-432c-aa82-fc7daf010a47 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:39.387422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9430-63f2-432c-aa82-fc7daf010a47 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:39.387422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee9430-63f2-432c-aa82-fc7daf010a47 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:39.388193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 736/1488] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:39.394259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf25413-824f-432c-8c70-9a24fa338978 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:39.394795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf25413-824f-432c-8c70-9a24fa338978 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:39.394795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf25413-824f-432c-8c70-9a24fa338978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:39.468913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2cf25413-824f-432c-8c70-9a24fa338978 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:39.470189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2cf25413-824f-432c-8c70-9a24fa338978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:39.531655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:39.581926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 753/1489] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:39.625124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee9430-63f2-432c-aa82-fc7daf010a47 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:39.626882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-caee9430-63f2-432c-aa82-fc7daf010a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:39.668570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:39.749664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee9430-63f2-432c-aa82-fc7daf010a47 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:39.842432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1fc1d-6acc-4084-9a59-f9a7f787a892 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:39.843003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1fc1d-6acc-4084-9a59-f9a7f787a892 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:39.843287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1fc1d-6acc-4084-9a59-f9a7f787a892 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:39.843561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1fc1d-6acc-4084-9a59-f9a7f787a892 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:39.845305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ece1fc1d-6acc-4084-9a59-f9a7f787a892 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:39.937056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:39.972435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1fc1d-6acc-4084-9a59-f9a7f787a892 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:39.973943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1fc1d-6acc-4084-9a59-f9a7f787a892 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:39.994235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 737/1490] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:18:42.573296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3d0f-97c3-4280-8c37-126bbfc755e5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:42.573826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3d0f-97c3-4280-8c37-126bbfc755e5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:42.573826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae3d0f-97c3-4280-8c37-126bbfc755e5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:42.575205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 754/1491] 10.222.0.27 () {54 vars in 926 bytes} [Mon Jul 18 06:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:18:42.580871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05e2-b4bd-4493-b492-42007310c207 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:42.581394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05e2-b4bd-4493-b492-42007310c207 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:42.581485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b05e2-b4bd-4493-b492-42007310c207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:42.659507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-267b05e2-b4bd-4493-b492-42007310c207 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:18:42.660739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-267b05e2-b4bd-4493-b492-42007310c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:42.782606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 738/1492] 10.222.0.27 () {58 vars in 1023 bytes} [Mon Jul 18 06:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:18:42.823917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3d0f-97c3-4280-8c37-126bbfc755e5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:18:42.825447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-29ae3d0f-97c3-4280-8c37-126bbfc755e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:42.943190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae3d0f-97c3-4280-8c37-126bbfc755e5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:18:43.025891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1afe8e-1a2e-4f67-9beb-2272dc3329da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:18:43.026585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1afe8e-1a2e-4f67-9beb-2272dc3329da service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:18:43.026893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1afe8e-1a2e-4f67-9beb-2272dc3329da service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:18:43.027192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1afe8e-1a2e-4f67-9beb-2272dc3329da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:18:43.029039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6a1afe8e-1a2e-4f67-9beb-2272dc3329da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:18:43.040253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:43.174077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1afe8e-1a2e-4f67-9beb-2272dc3329da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:18:43.175993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1afe8e-1a2e-4f67-9beb-2272dc3329da service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:18:43.196283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 755/1493] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:18:52.780201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=82 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:18:53.193098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=50 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:20:51.259620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c275f5-b119-4722-8b0b-883f433df239 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.260224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c275f5-b119-4722-8b0b-883f433df239 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.260224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c275f5-b119-4722-8b0b-883f433df239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.342206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c3c275f5-b119-4722-8b0b-883f433df239 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:20:51.343488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c3c275f5-b119-4722-8b0b-883f433df239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:20:51.450247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 739/1494] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:20:51.458705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5884cc-c012-460c-996c-42f68b85936d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.459259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5884cc-c012-460c-996c-42f68b85936d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.459259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5884cc-c012-460c-996c-42f68b85936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.478040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6b5884cc-c012-460c-996c-42f68b85936d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:20:51.479221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6b5884cc-c012-460c-996c-42f68b85936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:20:51.487775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 756/1495] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:20:51.493190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c275f5-b119-4722-8b0b-883f433df239 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:51.502850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c275f5-b119-4722-8b0b-883f433df239 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:51.507713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:51.508365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.508650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.508922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.509728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:20:51.509981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:51.510998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:51.510998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:20:51.510998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:20:51.511874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:51.523672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 740/1496] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:20:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:20:51.532604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5884cc-c012-460c-996c-42f68b85936d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:51.542672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5884cc-c012-460c-996c-42f68b85936d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:51.547335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:51.547989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.548275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.548551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.549276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:51.551007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:51.551007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 18 06:20:51.551007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: Jul 18 06:20:51.552955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:51.685266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 757/1497] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:20:51 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:20:51.689493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:51.699662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d77cb1-684b-4813-bca5-766aa30ea074 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:51.750455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:20:51.758107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:51.759008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.759130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.761248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.761248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:51.761248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:51.761248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:20:51.761248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:20:51.762378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:51.838242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 741/1498] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:20:51 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:20:51.842582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:51.853908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e3a749-f751-40ed-b19e-32ae5a8e49c0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:51.858502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:51.864153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.864153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.864153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.864153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:51.864153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:51.864153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 18 06:20:51.864153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: Jul 18 06:20:51.864916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:51.875216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 758/1499] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:20:51.879539 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:51.889620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bdde3-fbf5-44c3-8e76-242db5935b4f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:51.894175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34384d-4d69-4e35-bf86-1119ac71a639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:51.895394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34384d-4d69-4e35-bf86-1119ac71a639 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.895830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34384d-4d69-4e35-bf86-1119ac71a639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.896116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34384d-4d69-4e35-bf86-1119ac71a639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.896851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34384d-4d69-4e35-bf86-1119ac71a639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:51.897983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-cb34384d-4d69-4e35-bf86-1119ac71a639 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:51.897983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:20:51.897983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:20:51.898866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34384d-4d69-4e35-bf86-1119ac71a639 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:51.913507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 742/1500] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:20:51.917564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:51.927641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e88ea-f53e-4d5d-bd5b-69ff808713b2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:51.932222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e54a6d-8bc5-4b8a-9411-3206638ec2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:51.933163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54a6d-8bc5-4b8a-9411-3206638ec2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:51.933437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54a6d-8bc5-4b8a-9411-3206638ec2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:51.933716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e54a6d-8bc5-4b8a-9411-3206638ec2d6 admin admin] PATH_INFO: `/v3/projects/ebdeb4afce284ad8a1ad62ac045ba0fd/users/67a8feecb729471988cc4dfd369b423b/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:51.948469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54a6d-8bc5-4b8a-9411-3206638ec2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebdeb4afce284ad8a1ad62ac045ba0fd, user_id=67a8feecb729471988cc4dfd369b423b, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:51.949545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-e1e54a6d-8bc5-4b8a-9411-3206638ec2d6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:51.949545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 18 06:20:51.949545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: Jul 18 06:20:51.951484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e54a6d-8bc5-4b8a-9411-3206638ec2d6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:52.020882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 759/1501] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:20:51 2022] PUT /identity/v3/projects/ebdeb4afce284ad8a1ad62ac045ba0fd/users/67a8feecb729471988cc4dfd369b423b/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:20:52.033284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0069f-10ee-4ad6-8edd-5cc0235785a0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:52.033584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0069f-10ee-4ad6-8edd-5cc0235785a0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:52.033867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0069f-10ee-4ad6-8edd-5cc0235785a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:52.061514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-09c0069f-10ee-4ad6-8edd-5cc0235785a0 None None] MFA Rules not processed for user `67a8feecb729471988cc4dfd369b423b`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:20:52.062865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-09c0069f-10ee-4ad6-8edd-5cc0235785a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:20:52.129999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 743/1502] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:20:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:20:52.143808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c432da-3550-4285-bc95-14aa55eb9dfd None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:52.144102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c432da-3550-4285-bc95-14aa55eb9dfd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:52.144387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c432da-3550-4285-bc95-14aa55eb9dfd None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:52.146552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 760/1503] 10.222.0.27 () {54 vars in 964 bytes} [Mon Jul 18 06:20:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:20:52.151611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7baf-3737-418e-989e-f7bc3162f37a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:52.151902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7baf-3737-418e-989e-f7bc3162f37a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:52.152181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e7baf-3737-418e-989e-f7bc3162f37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:52.210056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-304e7baf-3737-418e-989e-f7bc3162f37a None None] MFA Rules not processed for user `f44e152499fc494085c738c67d0397f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:20:52.211265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-304e7baf-3737-418e-989e-f7bc3162f37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:20:52.286900 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 744/1504] 10.222.0.27 () {58 vars in 1061 bytes} [Mon Jul 18 06:20:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:20:52.294877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c432da-3550-4285-bc95-14aa55eb9dfd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:52.306151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c432da-3550-4285-bc95-14aa55eb9dfd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:52.309750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:52.310392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:52.310675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:52.310948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:52.320431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:52.321890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:52.330679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 761/1505] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:20:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:20:52.375200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e463e-968a-4321-bcd5-41144e25fb44 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:52.375492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e463e-968a-4321-bcd5-41144e25fb44 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:52.375795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e463e-968a-4321-bcd5-41144e25fb44 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:52.377129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 745/1506] 10.222.0.27 () {52 vars in 829 bytes} [Mon Jul 18 06:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:20:52.381491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:52.444757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c4313-d8bc-4160-a5f2-638aa588bf0d service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:52.449447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:52.450327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:52.450614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:52.450883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] PATH_INFO: `/v3/users/67a8feecb729471988cc4dfd369b423b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:52.452089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67a8feecb729471988cc4dfd369b423b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:52.453128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:52.453128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 18 06:20:52.453128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: Jul 18 06:20:52.454321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:52.713268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67a8feecb729471988cc4dfd369b423b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:52.797257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67a8feecb729471988cc4dfd369b423b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:52.797909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67a8feecb729471988cc4dfd369b423b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:52.818171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67a8feecb729471988cc4dfd369b423b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:52.818964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67a8feecb729471988cc4dfd369b423b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:52.829342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:20:52.841526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 762/1507] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:20:52 2022] DELETE /identity/v3/users/67a8feecb729471988cc4dfd369b423b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:20:52.846160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:52.846449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:52.846724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:52.865386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:20:52.866659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:20:52.875998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:20:52.927899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 746/1508] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:20:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:20:52.937939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:52.947535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:20:53.017878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee2c8bb-8c16-4ff5-b873-1b4b3674ca93 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:53.022176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ff5bf5-769d-47d5-94c1-88bb696a56b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:53.022820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5bf5-769d-47d5-94c1-88bb696a56b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:53.023574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5bf5-769d-47d5-94c1-88bb696a56b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:53.023574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ff5bf5-769d-47d5-94c1-88bb696a56b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:53.033177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff5bf5-769d-47d5-94c1-88bb696a56b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:53.034622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ff5bf5-769d-47d5-94c1-88bb696a56b6 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:53.044468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 763/1509] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:20:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:20:53.522044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:20:53.523445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:20:53.536671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed40cd-5fcb-4942-94a4-96f87f355d02 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:20:53.544247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:20:53.544247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:20:53.544247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:20:53.544247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] PATH_INFO: `/v3/projects/ebdeb4afce284ad8a1ad62ac045ba0fd` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:20:53.544667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebdeb4afce284ad8a1ad62ac045ba0fd)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:20:53.545616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:20:53.545616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:20:53.545616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:20:53.546802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:20:53.685109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebdeb4afce284ad8a1ad62ac045ba0fd', 'request_id': 'req-dce44d3d-1b09-4e99-a83f-c35f311ae206'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:53.691582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebdeb4afce284ad8a1ad62ac045ba0fd', 'request_id': 'req-dce44d3d-1b09-4e99-a83f-c35f311ae206'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:53.777432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebdeb4afce284ad8a1ad62ac045ba0fd', 'request_id': 'req-dce44d3d-1b09-4e99-a83f-c35f311ae206'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:53.796328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] The token cache is being invalidate because project ebdeb4afce284ad8a1ad62ac045ba0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:20:53.796643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:53.797284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dce44d3d-1b09-4e99-a83f-c35f311ae206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:20:53.798923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 747/1510] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:20:53 2022] DELETE /identity/v3/projects/ebdeb4afce284ad8a1ad62ac045ba0fd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:21:03.040099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=38 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:21:03.793343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:22:36.478095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c2da-37be-44b7-be8d-bb3512ffd8b5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:36.478702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c2da-37be-44b7-be8d-bb3512ffd8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:36.478702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0c2da-37be-44b7-be8d-bb3512ffd8b5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:36.480042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:22:36.485208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5bbe-2b16-40ac-ac97-08bc69e2d53a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:36.485701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5bbe-2b16-40ac-ac97-08bc69e2d53a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:36.485801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba5bbe-2b16-40ac-ac97-08bc69e2d53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:36.504458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2eba5bbe-2b16-40ac-ac97-08bc69e2d53a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:36.505721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2eba5bbe-2b16-40ac-ac97-08bc69e2d53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:36.566080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:22:36.725156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0c2da-37be-44b7-be8d-bb3512ffd8b5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:22:36.726861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8cf0c2da-37be-44b7-be8d-bb3512ffd8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:36.832056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0c2da-37be-44b7-be8d-bb3512ffd8b5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:22:36.837535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1d35ac-e8d1-4157-91e5-e8ec8f2b58b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:22:36.838811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d35ac-e8d1-4157-91e5-e8ec8f2b58b5 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:36.838811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d35ac-e8d1-4157-91e5-e8ec8f2b58b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:36.838811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1d35ac-e8d1-4157-91e5-e8ec8f2b58b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:36.847674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d35ac-e8d1-4157-91e5-e8ec8f2b58b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:22:36.849293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1d35ac-e8d1-4157-91e5-e8ec8f2b58b5 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:22:36.858844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 765/1513] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:22:37.717329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4d32-be7d-4c91-8c96-90f8de9ad86d None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:37.717903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4d32-be7d-4c91-8c96-90f8de9ad86d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:37.717903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac4d32-be7d-4c91-8c96-90f8de9ad86d None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:37.719308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:22:37.725430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe006d-cfbf-422b-a155-830e3069a69e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:37.725882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe006d-cfbf-422b-a155-830e3069a69e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:37.725977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe006d-cfbf-422b-a155-830e3069a69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:37.745554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a4fe006d-cfbf-422b-a155-830e3069a69e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:37.746768 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a4fe006d-cfbf-422b-a155-830e3069a69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:37.755306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:22:37.918792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac4d32-be7d-4c91-8c96-90f8de9ad86d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:22:37.934265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac4d32-be7d-4c91-8c96-90f8de9ad86d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:22:37.940002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb07d8b-9ded-476e-94d6-3e7f5ad21d55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:22:37.940659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07d8b-9ded-476e-94d6-3e7f5ad21d55 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:37.940942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07d8b-9ded-476e-94d6-3e7f5ad21d55 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:37.941252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb07d8b-9ded-476e-94d6-3e7f5ad21d55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:37.949793 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb07d8b-9ded-476e-94d6-3e7f5ad21d55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:22:37.951387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb07d8b-9ded-476e-94d6-3e7f5ad21d55 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:22:37.961263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 750/1516] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:22:38.434209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c7f7-ffb1-4dc8-8818-6a48722e638d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:38.434493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c7f7-ffb1-4dc8-8818-6a48722e638d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:38.434770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d316c7f7-ffb1-4dc8-8818-6a48722e638d None None] PATH_INFO: `/v3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:38.436096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 767/1517] 10.222.0.30 () {54 vars in 925 bytes} [Mon Jul 18 06:22:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:22:38.442451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83774be3-a89a-4302-8b4d-43e334298708 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:38.442751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83774be3-a89a-4302-8b4d-43e334298708 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:38.443065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83774be3-a89a-4302-8b4d-43e334298708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:38.494310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-83774be3-a89a-4302-8b4d-43e334298708 None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:38.495521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-83774be3-a89a-4302-8b4d-43e334298708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:38.569866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 751/1518] 10.222.0.30 () {58 vars in 1015 bytes} [Mon Jul 18 06:22:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:22:42.546363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6ccb-342e-4498-880a-fa7e1c877c68 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:42.546940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6ccb-342e-4498-880a-fa7e1c877c68 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:42.546940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6ccb-342e-4498-880a-fa7e1c877c68 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:42.548336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 768/1519] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 18 06:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:22:42.553668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d3eb-25c8-46a1-b628-810032cfb43d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:42.554529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d3eb-25c8-46a1-b628-810032cfb43d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:42.554800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690d3eb-25c8-46a1-b628-810032cfb43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:42.575716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b690d3eb-25c8-46a1-b628-810032cfb43d None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:42.577274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b690d3eb-25c8-46a1-b628-810032cfb43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:42.588193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 752/1520] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 18 06:22:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:22:42.598433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6ccb-342e-4498-880a-fa7e1c877c68 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:22:42.612732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6ccb-342e-4498-880a-fa7e1c877c68 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:22:42.617794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e2dbc-617b-407a-83df-e60a4bb34305 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:22:42.618428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2dbc-617b-407a-83df-e60a4bb34305 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:42.618706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2dbc-617b-407a-83df-e60a4bb34305 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:42.619003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e2dbc-617b-407a-83df-e60a4bb34305 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:42.628029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e2dbc-617b-407a-83df-e60a4bb34305 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:22:42.629714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06e2dbc-617b-407a-83df-e60a4bb34305 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:22:42.639488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 769/1521] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:22:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:22:49.196510 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2c66-a322-4aa4-b9f5-376c229040e3 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:49.197101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2c66-a322-4aa4-b9f5-376c229040e3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:49.197101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f2c66-a322-4aa4-b9f5-376c229040e3 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:49.198456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:22:49.203227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073796-b319-4233-ad59-9f33cbdf8770 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:49.203673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073796-b319-4233-ad59-9f33cbdf8770 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:49.204484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80073796-b319-4233-ad59-9f33cbdf8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:49.222598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-80073796-b319-4233-ad59-9f33cbdf8770 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:49.223801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-80073796-b319-4233-ad59-9f33cbdf8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:49.231727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:22:49.387551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f2c66-a322-4aa4-b9f5-376c229040e3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:22:49.402844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f2c66-a322-4aa4-b9f5-376c229040e3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:22:49.409221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4da12-63c0-4ff1-8ec4-db88139874a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:22:49.410822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4da12-63c0-4ff1-8ec4-db88139874a2 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:49.410822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4da12-63c0-4ff1-8ec4-db88139874a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:49.410822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4da12-63c0-4ff1-8ec4-db88139874a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:49.419083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4da12-63c0-4ff1-8ec4-db88139874a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:22:49.420656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4da12-63c0-4ff1-8ec4-db88139874a2 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:22:49.431041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 754/1524] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:22:50.260527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d90c38-b759-4804-8367-8533fd4bc193 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:50.261137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d90c38-b759-4804-8367-8533fd4bc193 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:50.261137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d90c38-b759-4804-8367-8533fd4bc193 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:50.262484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 06:22:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:22:50.267861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9ce3-0a63-4304-b149-f882a27462a7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:50.268293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9ce3-0a63-4304-b149-f882a27462a7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:50.268534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab9ce3-0a63-4304-b149-f882a27462a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:50.287264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-87ab9ce3-0a63-4304-b149-f882a27462a7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:50.288458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-87ab9ce3-0a63-4304-b149-f882a27462a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:50.296517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 06:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:22:50.451541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d90c38-b759-4804-8367-8533fd4bc193 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:22:50.466541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d90c38-b759-4804-8367-8533fd4bc193 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:22:50.472943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da609f-8d7c-41cd-ae0b-a1076a2d9d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:22:50.473615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da609f-8d7c-41cd-ae0b-a1076a2d9d01 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:50.473902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da609f-8d7c-41cd-ae0b-a1076a2d9d01 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:50.474177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da609f-8d7c-41cd-ae0b-a1076a2d9d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:50.482590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da609f-8d7c-41cd-ae0b-a1076a2d9d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:22:50.484168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da609f-8d7c-41cd-ae0b-a1076a2d9d01 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:22:50.494004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 772/1527] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:22:54.351268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835534-7b31-4cab-98d4-8f3c62d1c11c None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:54.351650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835534-7b31-4cab-98d4-8f3c62d1c11c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:54.351782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89835534-7b31-4cab-98d4-8f3c62d1c11c None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:54.353195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:22:54.358450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce037396-2112-4fac-9316-519696243291 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:54.358851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce037396-2112-4fac-9316-519696243291 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:54.359067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce037396-2112-4fac-9316-519696243291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:54.377610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ce037396-2112-4fac-9316-519696243291 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:54.378726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ce037396-2112-4fac-9316-519696243291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:54.386645 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:22:54.425001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835534-7b31-4cab-98d4-8f3c62d1c11c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:22:54.430710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-89835534-7b31-4cab-98d4-8f3c62d1c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:54.456323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:22:54.485644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89835534-7b31-4cab-98d4-8f3c62d1c11c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:22:54.489617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282015b-36de-46f2-b5c7-62c8556f59cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:22:54.490257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282015b-36de-46f2-b5c7-62c8556f59cc service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:54.490566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282015b-36de-46f2-b5c7-62c8556f59cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:54.490840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282015b-36de-46f2-b5c7-62c8556f59cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:54.499753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282015b-36de-46f2-b5c7-62c8556f59cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:22:54.502220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2282015b-36de-46f2-b5c7-62c8556f59cc service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:22:54.511586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 757/1530] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:22:56.529424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32893b-8757-4573-befa-a1a52bd56560 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:56.529997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32893b-8757-4573-befa-a1a52bd56560 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:56.529997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32893b-8757-4573-befa-a1a52bd56560 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:56.531372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:22:56.537536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b15374-4c71-4adc-9a56-e79a03077683 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:56.537983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b15374-4c71-4adc-9a56-e79a03077683 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:56.538079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b15374-4c71-4adc-9a56-e79a03077683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:56.555838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-63b15374-4c71-4adc-9a56-e79a03077683 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:22:56.557066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-63b15374-4c71-4adc-9a56-e79a03077683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:22:56.565634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:22:56.601769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32893b-8757-4573-befa-a1a52bd56560 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:22:56.612524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32893b-8757-4573-befa-a1a52bd56560 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:22:56.616082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f5d0f-888d-4902-bd2b-29e3bb5d108e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:22:56.616718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f5d0f-888d-4902-bd2b-29e3bb5d108e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:22:56.617042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f5d0f-888d-4902-bd2b-29e3bb5d108e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:22:56.617330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f5d0f-888d-4902-bd2b-29e3bb5d108e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:22:56.627011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f5d0f-888d-4902-bd2b-29e3bb5d108e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:22:56.628474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f5d0f-888d-4902-bd2b-29e3bb5d108e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:22:56.638179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 775/1533] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:23:00.099908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277d89-82d4-48d4-8c78-7065d312a8f0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:23:00.100517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277d89-82d4-48d4-8c78-7065d312a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:23:00.100517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277d89-82d4-48d4-8c78-7065d312a8f0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:23:00.101856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:23:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:23:00.107124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60e81-6d6a-431c-a47a-a2f446a64c22 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:23:00.107577 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60e81-6d6a-431c-a47a-a2f446a64c22 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:23:00.107692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f60e81-6d6a-431c-a47a-a2f446a64c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:23:00.127590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b3f60e81-6d6a-431c-a47a-a2f446a64c22 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:23:00.128793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b3f60e81-6d6a-431c-a47a-a2f446a64c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:23:00.136674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:23:00.446721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6277d89-82d4-48d4-8c78-7065d312a8f0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:23:00.448396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b6277d89-82d4-48d4-8c78-7065d312a8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:23:00.505943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6277d89-82d4-48d4-8c78-7065d312a8f0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:23:00.509491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd68268-7bb5-4898-84ac-222f7cbbc225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:23:00.510135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68268-7bb5-4898-84ac-222f7cbbc225 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:23:00.510417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68268-7bb5-4898-84ac-222f7cbbc225 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:23:00.510694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd68268-7bb5-4898-84ac-222f7cbbc225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:23:00.520038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd68268-7bb5-4898-84ac-222f7cbbc225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:23:00.521495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd68268-7bb5-4898-84ac-222f7cbbc225 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:23:00.531181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 760/1536] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:23:02.571805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06b2e-f0ba-4657-85cb-4f5f5c0a5ba5 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:23:02.572376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06b2e-f0ba-4657-85cb-4f5f5c0a5ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:23:02.572376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f06b2e-f0ba-4657-85cb-4f5f5c0a5ba5 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:23:02.573795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 06:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:23:02.579911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d35376-3461-4902-a733-41f2a5e66db4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:23:02.580359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d35376-3461-4902-a733-41f2a5e66db4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:23:02.580478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d35376-3461-4902-a733-41f2a5e66db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:23:02.599338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f1d35376-3461-4902-a733-41f2a5e66db4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:23:02.600540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1d35376-3461-4902-a733-41f2a5e66db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:23:02.608399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 06:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:23:02.911891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06b2e-f0ba-4657-85cb-4f5f5c0a5ba5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:23:02.913618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37f06b2e-f0ba-4657-85cb-4f5f5c0a5ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:23:02.927524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f06b2e-f0ba-4657-85cb-4f5f5c0a5ba5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:23:02.931090 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ccb35-9bfd-45a8-af89-edd29a0307a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:23:02.931733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ccb35-9bfd-45a8-af89-edd29a0307a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:23:02.932054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ccb35-9bfd-45a8-af89-edd29a0307a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:23:02.932335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ccb35-9bfd-45a8-af89-edd29a0307a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:23:02.941496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ccb35-9bfd-45a8-af89-edd29a0307a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:23:02.942947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ccb35-9bfd-45a8-af89-edd29a0307a9 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:23:02.952390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 778/1539] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:23:12.594219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=47 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:23:12.948182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=82 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:35.095033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de5604-0a91-4b4f-bef0-f57a5dc78d64 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.095752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de5604-0a91-4b4f-bef0-f57a5dc78d64 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.095752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de5604-0a91-4b4f-bef0-f57a5dc78d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.127079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e2de5604-0a91-4b4f-bef0-f57a5dc78d64 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.128307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e2de5604-0a91-4b4f-bef0-f57a5dc78d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.144002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 762/1540] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:24:35.155929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987ef9-cab3-4993-bf5c-b0e9024b9c60 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.156555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987ef9-cab3-4993-bf5c-b0e9024b9c60 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.156555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad987ef9-cab3-4993-bf5c-b0e9024b9c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.180381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ad987ef9-cab3-4993-bf5c-b0e9024b9c60 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.183903 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ad987ef9-cab3-4993-bf5c-b0e9024b9c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.200351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 779/1541] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.204849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de5604-0a91-4b4f-bef0-f57a5dc78d64 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.221304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de5604-0a91-4b4f-bef0-f57a5dc78d64 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.229008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.229704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.229991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.230272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.231008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:35.231318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.232927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.263985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 763/1542] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:35.273089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad987ef9-cab3-4993-bf5c-b0e9024b9c60 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.283859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad987ef9-cab3-4993-bf5c-b0e9024b9c60 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.295912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094fd66-74de-4b92-aee1-4e7898baf1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.295912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094fd66-74de-4b92-aee1-4e7898baf1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.295912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094fd66-74de-4b92-aee1-4e7898baf1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.295912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094fd66-74de-4b92-aee1-4e7898baf1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.296373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094fd66-74de-4b92-aee1-4e7898baf1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.297001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094fd66-74de-4b92-aee1-4e7898baf1d5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.422894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 780/1543] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:35.427529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.443058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e29c06-a8ac-437c-a411-780003425bf5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.483936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ac736-f31c-4600-b1cb-8eb908f8884e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.484312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ac736-f31c-4600-b1cb-8eb908f8884e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.484514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ac736-f31c-4600-b1cb-8eb908f8884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.511022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3b3ac736-f31c-4600-b1cb-8eb908f8884e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.512246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3b3ac736-f31c-4600-b1cb-8eb908f8884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.536764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c07d5-181c-40f8-956f-9bec2c9fadfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.537490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c07d5-181c-40f8-956f-9bec2c9fadfa admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.537778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c07d5-181c-40f8-956f-9bec2c9fadfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.538055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c07d5-181c-40f8-956f-9bec2c9fadfa admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.538767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c07d5-181c-40f8-956f-9bec2c9fadfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.540709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c07d5-181c-40f8-956f-9bec2c9fadfa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.594989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 781/1544] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:24:35.596403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d340a6b-8250-4a08-9f86-4e09a95166b7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.596700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d340a6b-8250-4a08-9f86-4e09a95166b7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.596994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d340a6b-8250-4a08-9f86-4e09a95166b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.622758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9d340a6b-8250-4a08-9f86-4e09a95166b7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.624430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d340a6b-8250-4a08-9f86-4e09a95166b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.633698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 782/1545] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.635973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca42a-4058-4089-9147-bed98650a010 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.636184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca42a-4058-4089-9147-bed98650a010 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.636562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca42a-4058-4089-9147-bed98650a010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.658617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1baca42a-4058-4089-9147-bed98650a010 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.660551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1baca42a-4058-4089-9147-bed98650a010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.667672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 764/1546] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/users => generated 293 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:35.670375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b465-d5fb-4c32-9dc8-bc6f86cc70d2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.670375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b465-d5fb-4c32-9dc8-bc6f86cc70d2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.670582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 783/1547] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.670689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b465-d5fb-4c32-9dc8-bc6f86cc70d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.670799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848893b-162e-4957-bcd6-03dc99bb60ac None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.670903 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848893b-162e-4957-bcd6-03dc99bb60ac None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.671280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f848893b-162e-4957-bcd6-03dc99bb60ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.690801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f848893b-162e-4957-bcd6-03dc99bb60ac None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.692800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dc07b465-d5fb-4c32-9dc8-bc6f86cc70d2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.693199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f848893b-162e-4957-bcd6-03dc99bb60ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.694061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dc07b465-d5fb-4c32-9dc8-bc6f86cc70d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.701588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 784/1548] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.702859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1dfb9-74f5-4622-aabc-c8c4bdcaf722 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.703145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1dfb9-74f5-4622-aabc-c8c4bdcaf722 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.703415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1dfb9-74f5-4622-aabc-c8c4bdcaf722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.706102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 765/1549] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.708080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8def-7741-4e12-9765-f2a4a7c3e53e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.708373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8def-7741-4e12-9765-f2a4a7c3e53e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.708642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959f8def-7741-4e12-9765-f2a4a7c3e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.722906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-27d1dfb9-74f5-4622-aabc-c8c4bdcaf722 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.724125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-27d1dfb9-74f5-4622-aabc-c8c4bdcaf722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.728081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-959f8def-7741-4e12-9765-f2a4a7c3e53e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.729317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-959f8def-7741-4e12-9765-f2a4a7c3e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.732272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 785/1550] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.733622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b1e2-bbe9-43b6-8929-d6ca40df0cc8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.733915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b1e2-bbe9-43b6-8929-d6ca40df0cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.734271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27b1e2-bbe9-43b6-8929-d6ca40df0cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.737731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 766/1551] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.739516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516af741-2005-4972-974b-ce3401e3a1bb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.739804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516af741-2005-4972-974b-ce3401e3a1bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.740081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516af741-2005-4972-974b-ce3401e3a1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.753013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cb27b1e2-bbe9-43b6-8929-d6ca40df0cc8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.754863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cb27b1e2-bbe9-43b6-8929-d6ca40df0cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.760083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-516af741-2005-4972-974b-ce3401e3a1bb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.761291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-516af741-2005-4972-974b-ce3401e3a1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.762902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 786/1552] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.763840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27b1e2-bbe9-43b6-8929-d6ca40df0cc8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.771692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 767/1553] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.773273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc87c3-e877-47b8-902a-f0d9bede9230 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.773574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc87c3-e877-47b8-902a-f0d9bede9230 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.773833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc87c3-e877-47b8-902a-f0d9bede9230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.775933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27b1e2-bbe9-43b6-8929-d6ca40df0cc8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.780670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.781357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.781643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.781922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.782648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.784264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.794889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 787/1554] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:35.795814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.798129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2bdc87c3-e877-47b8-902a-f0d9bede9230 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.799200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2bdc87c3-e877-47b8-902a-f0d9bede9230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.807361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8bdaa-242f-4a10-97d3-20e3e0c956a9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.807924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 768/1555] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.809035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9d7b-04ae-4ed8-b3ec-09d2cf23d558 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.809328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9d7b-04ae-4ed8-b3ec-09d2cf23d558 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.809612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e9d7b-04ae-4ed8-b3ec-09d2cf23d558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.815563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.816780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.817180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.817463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.818202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:35.818504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.819527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:24:35.819527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 18 06:24:35.819527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: Jul 18 06:24:35.820443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6e6a0-00ae-4662-b5ee-04e680a7af84 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.828418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-998e9d7b-04ae-4ed8-b3ec-09d2cf23d558 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.829656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-998e9d7b-04ae-4ed8-b3ec-09d2cf23d558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.833266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 788/1556] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:35.834626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0f717-8bb7-4ec1-8fa6-0e7ab2aef51c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.834926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0f717-8bb7-4ec1-8fa6-0e7ab2aef51c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.835215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0f717-8bb7-4ec1-8fa6-0e7ab2aef51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.843122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 769/1557] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.843122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9d7b-04ae-4ed8-b3ec-09d2cf23d558 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.849998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e9d7b-04ae-4ed8-b3ec-09d2cf23d558 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.854956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ee99d-a6bf-4713-a380-3cb444ee1e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.855852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee99d-a6bf-4713-a380-3cb444ee1e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.856235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee99d-a6bf-4713-a380-3cb444ee1e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.856632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ee99d-a6bf-4713-a380-3cb444ee1e31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.857835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ee99d-a6bf-4713-a380-3cb444ee1e31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:35.857972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c6b0f717-8bb7-4ec1-8fa6-0e7ab2aef51c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.858261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ee99d-a6bf-4713-a380-3cb444ee1e31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.859124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c6b0f717-8bb7-4ec1-8fa6-0e7ab2aef51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.860728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ee99d-a6bf-4713-a380-3cb444ee1e31 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.867974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 789/1558] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.869283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fe68-52db-41dc-a640-c5eb55492a9b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.869574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fe68-52db-41dc-a640-c5eb55492a9b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.869838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30fe68-52db-41dc-a640-c5eb55492a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.873910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 770/1559] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:35.875044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada099-a2a0-44a7-abba-d5f1d922ec8c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.875335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada099-a2a0-44a7-abba-d5f1d922ec8c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.875613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada099-a2a0-44a7-abba-d5f1d922ec8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.889718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6d30fe68-52db-41dc-a640-c5eb55492a9b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.890904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6d30fe68-52db-41dc-a640-c5eb55492a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.894762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5cada099-a2a0-44a7-abba-d5f1d922ec8c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:35.895944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5cada099-a2a0-44a7-abba-d5f1d922ec8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:35.899281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 790/1560] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.900323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30fe68-52db-41dc-a640-c5eb55492a9b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.907964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 771/1561] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:35.909343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada099-a2a0-44a7-abba-d5f1d922ec8c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.909820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30fe68-52db-41dc-a640-c5eb55492a9b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.914717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.915374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.915656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.916428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.916670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.918267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.919915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada099-a2a0-44a7-abba-d5f1d922ec8c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.924619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.925302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.926250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.926536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.927367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:35.927848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.929433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.929722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 791/1562] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:35.930513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.942209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648f35f-a66e-42cc-a244-ce03ed32b8ab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.942429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 772/1563] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:35.944279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.948034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.948689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.948972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.949273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.949960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.951882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.954699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3b084-8abe-4d6b-9c6e-130503a306eb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.959554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.960217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.960505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.960787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.962062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:35.962371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.963970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:35.976306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 773/1564] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:35.977181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:35.986699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb997f-71dc-4b5f-a3f8-b66277daad1c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:35.992268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:35.992957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:35.993320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:35.993606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:35.994323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:35.994635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:35.996239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.008936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 774/1565] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:36.010445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.019922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d705cbb-69c5-42ad-9ba9-b4920d326b19 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.025175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.025811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.026100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.026424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.027111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.028159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:24:36.028159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:24:36.028159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:24:36.029387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.035962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 792/1566] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:35 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.036811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.068629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:36.099797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9d2be-a5f2-45b4-a09f-2fc80450076d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.104415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.105108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.105390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.105673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.106394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:36.106701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.108294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.110086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 775/1567] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.111016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.129687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 793/1568] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:36.129687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.132676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:36.134743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13517a-3c58-4765-8703-847adb7bfcd3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.178713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7f9da-e180-43d5-b9ff-8801d44e597f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.183907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.184615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.184903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.185216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.185947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:36.186254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.187893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.194059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.194982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.195259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.195535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] PATH_INFO: `/v3/projects/2ef040fcb9d4462db31faa18de2f0876/users/ab05ad428bef4632bb0e78cbf427850a/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.201098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 776/1569] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:36.201923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.215275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef040fcb9d4462db31faa18de2f0876, user_id=ab05ad428bef4632bb0e78cbf427850a, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.217962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.218112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b0657-f0ee-4f17-8d0d-1fe208c1fb02 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.223900 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.224616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.224907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.225210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.225907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.227824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.286070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 794/1570] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:36 2022] PUT /identity/v3/projects/2ef040fcb9d4462db31faa18de2f0876/users/ab05ad428bef4632bb0e78cbf427850a/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:36.286900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.315633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 777/1571] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.316832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.350958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af007639-4194-409c-8d50-f82898730a82 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.379094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b22d131-b949-492f-9537-0f264ef8e8ca admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.384802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.385400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.385715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.385996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.386770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.388772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.400517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:36.408916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.415155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.415155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.415155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.415155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.415155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.469790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 778/1572] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.470762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.502015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 795/1573] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/projects => generated 383 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.502015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.540635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22587397-a257-4311-8729-96d4ce4840ed admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.558152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:36.561400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a66d90-0b84-4ffe-8ac3-19a4ae6f53d6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.567157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.567850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.578911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.578911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.578911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.578911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:24:36.578911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 18 06:24:36.578911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: Jul 18 06:24:36.578911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.598366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.601823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.601823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.601823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.601823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.602698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.684899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 796/1574] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.685820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.696134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e564a2-3b52-4c95-9a21-c79d4ff1bec1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.700714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a212e-9c5a-45c6-a260-aa480a425461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.701380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a212e-9c5a-45c6-a260-aa480a425461 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.701665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a212e-9c5a-45c6-a260-aa480a425461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.701942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a212e-9c5a-45c6-a260-aa480a425461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.702639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a212e-9c5a-45c6-a260-aa480a425461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.704555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a212e-9c5a-45c6-a260-aa480a425461 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.715326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 779/1575] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.719161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.729111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2b340-0246-45d0-9816-560b85575c3c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.733703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.734356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.734640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.734922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.735611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.737555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.812291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 797/1576] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.813642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283751d-cfbc-463e-8658-a13011a8e1fd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.813925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283751d-cfbc-463e-8658-a13011a8e1fd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.814241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e283751d-cfbc-463e-8658-a13011a8e1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.835227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 780/1577] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:36.839508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.842164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e283751d-cfbc-463e-8658-a13011a8e1fd None None] MFA Rules not processed for user `ab05ad428bef4632bb0e78cbf427850a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:36.843465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e283751d-cfbc-463e-8658-a13011a8e1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:36.903041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9bd31-fb08-4953-85e4-b2b0f320bf44 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.907706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.908381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.908665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.908939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.909657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.912406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 798/1578] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:36.912821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:36.913250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283751d-cfbc-463e-8658-a13011a8e1fd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:36.924215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e283751d-cfbc-463e-8658-a13011a8e1fd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:36.930195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:36.930884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:36.931195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:36.931465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:36.932149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:36.934100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.033983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 781/1579] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:37.034722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.045071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d7487-c3dd-40cd-ae54-658960e3a6d8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.049795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.050270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 799/1580] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:36 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:37.051074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.051456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.052056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.052177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.052773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.054951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.063907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e63efc-340d-439b-a6fc-4d17818137c8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.068838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.075714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.075714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.075714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.075714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.075714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.082510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 800/1581] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.083358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.094512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6175d6-7439-4ce3-a0b8-f3a6997c8647 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.099667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.100454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.100737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.101041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.101744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.103283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.104529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:37.114810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 801/1582] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.121676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.124865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663df4a4-a226-407f-b1b0-8d0ba318030c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.129635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.130253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.130535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.130810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.131479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.133370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.148739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 782/1583] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:37 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:37.150029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.159531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43bfea-bd28-4830-adff-e04cfd296958 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.165073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.165714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.165997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.166280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.166953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.168848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.243846 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 802/1584] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:37 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:37.243846 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.251767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446ee3b-41d3-49db-885f-38ec5f1bf171 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.257138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.257780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.258064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.258345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.259043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.260959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.269195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 783/1585] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:37 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:37.270893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.281121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df42bdb-ae52-4308-be41-59128e7385fe admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.292687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.292687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.292687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.292687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.293145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.293145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.304134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 784/1586] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.304808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.315003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a052e8-41af-4245-a7bc-c5dd3431db7f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.321122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.321822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.322101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.322375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.323115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.325246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.336556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 785/1587] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.337452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.349100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84568d-86ac-4f48-9c1e-8d2e85c39525 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.354416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.355095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.355358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.355776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 803/1588] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:37 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:37.355911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.356378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.356486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.358028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.369630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 786/1589] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.370312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.381117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4084f-e6cb-4dc6-9441-2d3a486d447d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.386125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:37.423263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988c57-bf19-474b-bd5c-736e69f5f40a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.428305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.428967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.429279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.429552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.430278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.431879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.441106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.442134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.442134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.442486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 804/1590] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.443309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.445778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.446545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.448235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.452800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb774e-eb7e-4d6c-b245-47e1f0f76834 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.458569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.459132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 787/1591] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.459534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.459900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.460014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.460189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.461072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.462965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.470818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980953aa-ac9d-40a5-83a1-8b1ec687a3c4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.474489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 805/1592] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.482109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.482449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.482449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.482449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.482449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.482842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.482842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.487685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba5646-c23b-4fef-bbd4-d319c59f50ca admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.492421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 788/1593] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.493286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.496507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.497221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.497509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.497791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.498544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.500272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.503080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483eda0-e5a2-4672-a398-08b4ef7f7545 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.508120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.510879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.510879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.510879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.510879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.511760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 806/1594] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.511873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.512702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.526832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 789/1595] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.527052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d29be-2455-49b6-95b8-ecdf165b4a48 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.527185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.529456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.529977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.530279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.530542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.531260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.533253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.538661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1649b08-d6c5-4e2b-b6f7-76adead72ce8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.543709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.544782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.545232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.545640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] PATH_INFO: `/v3/projects/5c7f4041159f4c95ae01378d3e9b7cc0/users/63e8f6b8d22144ee9534cadbdcb06b20/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.562665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7f4041159f4c95ae01378d3e9b7cc0, user_id=63e8f6b8d22144ee9534cadbdcb06b20, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.563734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:24:37.563734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:24:37.563734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:24:37.565930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.594423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 807/1596] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:37 2022] POST /identity/v3/users => generated 299 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:37.595271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.604874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daedef7e-54a6-4b21-acd3-879c9b42534e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.609470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.610334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.610612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.611591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] PATH_INFO: `/v3/projects/8deff878f0b64c749b882ec6501d62eb/users/a55d7218269c4b7aad2fb29e6f0b8baf/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.627097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8deff878f0b64c749b882ec6501d62eb, user_id=a55d7218269c4b7aad2fb29e6f0b8baf, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.629996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 790/1597] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:37 2022] PUT /identity/v3/projects/5c7f4041159f4c95ae01378d3e9b7cc0/users/63e8f6b8d22144ee9534cadbdcb06b20/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:37.645935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.646092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.692384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e5f93-91a6-4ad7-9791-cb2b35c7d946 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.697134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.697804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.698087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.698367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.699089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.700782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.710818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 791/1598] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.711666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.720478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 808/1599] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:37 2022] PUT /identity/v3/projects/8deff878f0b64c749b882ec6501d62eb/users/a55d7218269c4b7aad2fb29e6f0b8baf/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:37.721526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.729762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebca6b-418c-4e25-a7dd-e348defc7c20 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.774440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:37.786404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:37.789065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff0563-32da-40a3-a6a0-29cf95308937 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.794532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.794895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.795533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.795649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.795845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.795950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.796123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.796228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.796856 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.796959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.798488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.798612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.809534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 809/1600] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.809979 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 792/1601] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:37.810487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.810804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.821118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f083d-ec42-4e54-94a1-d630824f04c9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.821872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa89b3-2d1c-4240-a71b-944ccafbb355 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:37.825708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.826526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3dd02-300a-43cb-8c7c-d7317a4a4b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:37.826654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.826870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.827148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] PATH_INFO: `/v3/projects/722e4100a04e4b7c877eedb6b2d8c670/users/1c4e450af95547bc9c633612b110858e/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.827473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3dd02-300a-43cb-8c7c-d7317a4a4b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.827855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3dd02-300a-43cb-8c7c-d7317a4a4b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.828093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3dd02-300a-43cb-8c7c-d7317a4a4b94 admin admin] PATH_INFO: `/v3/projects/e9f2e448b914421bbff31e0aa9478b67/users/1a4d9b43b40842ffb3ae76dd6dfef305/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.843601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722e4100a04e4b7c877eedb6b2d8c670, user_id=1c4e450af95547bc9c633612b110858e, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.845257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3dd02-300a-43cb-8c7c-d7317a4a4b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9f2e448b914421bbff31e0aa9478b67, user_id=1a4d9b43b40842ffb3ae76dd6dfef305, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:37.846350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.848523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3dd02-300a-43cb-8c7c-d7317a4a4b94 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:37.943745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 810/1602] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:37 2022] PUT /identity/v3/projects/722e4100a04e4b7c877eedb6b2d8c670/users/1c4e450af95547bc9c633612b110858e/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:37.944010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 793/1603] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:37 2022] PUT /identity/v3/projects/e9f2e448b914421bbff31e0aa9478b67/users/1a4d9b43b40842ffb3ae76dd6dfef305/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:37.944870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:37.945353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76885ee-6bd7-4689-83d8-0a30cbbb1d1f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:37.945637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76885ee-6bd7-4689-83d8-0a30cbbb1d1f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:37.945932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76885ee-6bd7-4689-83d8-0a30cbbb1d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:37.976541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d76885ee-6bd7-4689-83d8-0a30cbbb1d1f None None] MFA Rules not processed for user `63e8f6b8d22144ee9534cadbdcb06b20`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:37.977865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d76885ee-6bd7-4689-83d8-0a30cbbb1d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.011942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0746e-fb13-4530-81f9-154b97d4d626 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.016812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.017733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.018131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.018514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.020097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.021786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.032215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 811/1604] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:38.033087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.045972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d236-2885-45bd-a291-22a077331361 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.051087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 794/1605] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:38.051383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.052420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.052538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751c03-55b3-48da-bd62-3f260dc1a6f8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.052703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.052815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751c03-55b3-48da-bd62-3f260dc1a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.053000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] PATH_INFO: `/v3/projects/72e1d7dc4f534a68a766568ee999ab86/users/4b57f9679e65450b9d97b0ce893fd6bd/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.053124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2751c03-55b3-48da-bd62-3f260dc1a6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.069875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e1d7dc4f534a68a766568ee999ab86, user_id=4b57f9679e65450b9d97b0ce893fd6bd, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.072588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.079277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a2751c03-55b3-48da-bd62-3f260dc1a6f8 None None] MFA Rules not processed for user `a55d7218269c4b7aad2fb29e6f0b8baf`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:38.080498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a2751c03-55b3-48da-bd62-3f260dc1a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.143289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 795/1606] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:38.144149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751c03-55b3-48da-bd62-3f260dc1a6f8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.154445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2751c03-55b3-48da-bd62-3f260dc1a6f8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.159648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91458d-75bd-42ea-b9f2-d7def72bcb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.160954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91458d-75bd-42ea-b9f2-d7def72bcb67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.161277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91458d-75bd-42ea-b9f2-d7def72bcb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.161551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91458d-75bd-42ea-b9f2-d7def72bcb67 admin admin] PATH_INFO: `/v3/projects/d0c8e5c995c84989bbdf244efe72da2e/users/e7d1d99f0b074def89c572d944f8469a/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.165516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 812/1607] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:38 2022] PUT /identity/v3/projects/72e1d7dc4f534a68a766568ee999ab86/users/4b57f9679e65450b9d97b0ce893fd6bd/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:38.166340 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.179226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91458d-75bd-42ea-b9f2-d7def72bcb67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0c8e5c995c84989bbdf244efe72da2e, user_id=e7d1d99f0b074def89c572d944f8469a, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.181894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91458d-75bd-42ea-b9f2-d7def72bcb67 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.231299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bac750-7d81-4c6e-a58d-280a24a5fc21 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.235988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d5405-32a5-47d2-ab7f-6228d531caf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.236869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d5405-32a5-47d2-ab7f-6228d531caf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.237180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d5405-32a5-47d2-ab7f-6228d531caf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.237527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d5405-32a5-47d2-ab7f-6228d531caf3 admin admin] PATH_INFO: `/v3/projects/3d657637191a4cec927bd7af8d97964c/users/4473d6258f574d3789abe9d068fc313f/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.252400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d5405-32a5-47d2-ab7f-6228d531caf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d657637191a4cec927bd7af8d97964c, user_id=4473d6258f574d3789abe9d068fc313f, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.255856 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d5405-32a5-47d2-ab7f-6228d531caf3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.262446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 796/1608] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:38 2022] PUT /identity/v3/projects/d0c8e5c995c84989bbdf244efe72da2e/users/e7d1d99f0b074def89c572d944f8469a/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:38.263780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808304a-e431-434e-881a-7ce92ec1288f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.267346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808304a-e431-434e-881a-7ce92ec1288f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.267346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0808304a-e431-434e-881a-7ce92ec1288f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.281741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0808304a-e431-434e-881a-7ce92ec1288f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:38.282952 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0808304a-e431-434e-881a-7ce92ec1288f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.300809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:38.342888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 813/1609] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:38 2022] PUT /identity/v3/projects/3d657637191a4cec927bd7af8d97964c/users/4473d6258f574d3789abe9d068fc313f/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:38.344487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e213-22d4-409a-8dfb-58a25edb0540 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.344772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e213-22d4-409a-8dfb-58a25edb0540 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.345071 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df75e213-22d4-409a-8dfb-58a25edb0540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.352907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 797/1610] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:38.352907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808304a-e431-434e-881a-7ce92ec1288f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.363980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0808304a-e431-434e-881a-7ce92ec1288f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.369866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-df75e213-22d4-409a-8dfb-58a25edb0540 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:38.371101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df75e213-22d4-409a-8dfb-58a25edb0540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.380568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:38.428968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.429883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.430165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.430436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] PATH_INFO: `/v3/projects/a7572eee753249a8a6b73ba7731a72b7/users/a26f6ef3f5ea4bddbdbc1aca8dc399af/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.437798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 814/1611] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:38.438733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75e213-22d4-409a-8dfb-58a25edb0540 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.447975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7572eee753249a8a6b73ba7731a72b7, user_id=a26f6ef3f5ea4bddbdbc1aca8dc399af, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.450739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df75e213-22d4-409a-8dfb-58a25edb0540 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.451720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.455341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947e7159-e0aa-4924-809e-7af9b99de1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.456008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7159-e0aa-4924-809e-7af9b99de1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.456283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7159-e0aa-4924-809e-7af9b99de1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.456597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e7159-e0aa-4924-809e-7af9b99de1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.458122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e7159-e0aa-4924-809e-7af9b99de1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.460003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947e7159-e0aa-4924-809e-7af9b99de1cc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.543355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 798/1612] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:38 2022] PUT /identity/v3/projects/a7572eee753249a8a6b73ba7731a72b7/users/a26f6ef3f5ea4bddbdbc1aca8dc399af/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:38.544241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.559659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 815/1613] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/projects => generated 403 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:38.559659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac420071-db52-440f-a3c7-6dfd961eaef6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.559659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac420071-db52-440f-a3c7-6dfd961eaef6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.559659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac420071-db52-440f-a3c7-6dfd961eaef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.575786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ac420071-db52-440f-a3c7-6dfd961eaef6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:38.576997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ac420071-db52-440f-a3c7-6dfd961eaef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.611553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed2965-6593-44df-95ad-f6664d2613e0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.638218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 816/1614] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:38.639381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5e89f-e4c1-4869-bdd1-55b107e2a8bf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.639669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5e89f-e4c1-4869-bdd1-55b107e2a8bf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.639947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5e89f-e4c1-4869-bdd1-55b107e2a8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.658318 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-26f5e89f-e4c1-4869-bdd1-55b107e2a8bf None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:38.659573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-26f5e89f-e4c1-4869-bdd1-55b107e2a8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.663051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:38.668250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 817/1615] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:38.669673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e4654-ee61-4c89-a23c-a79cbcc99d13 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.669958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e4654-ee61-4c89-a23c-a79cbcc99d13 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.670233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e4654-ee61-4c89-a23c-a79cbcc99d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.675201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.676909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.677391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.678103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.678820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.680799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.699171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-028e4654-ee61-4c89-a23c-a79cbcc99d13 None None] MFA Rules not processed for user `4473d6258f574d3789abe9d068fc313f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:38.700375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-028e4654-ee61-4c89-a23c-a79cbcc99d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.765010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 818/1616] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:38.765609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e4654-ee61-4c89-a23c-a79cbcc99d13 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.782698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 799/1617] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/projects => generated 385 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:38.783815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.786454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:38.828053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e4654-ee61-4c89-a23c-a79cbcc99d13 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.844430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4b7a1-2ff2-4bf4-a812-574fcda40b0a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.848353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.849028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.849317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.849593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.880348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.881026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.881311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.881583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.913865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.915333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.925864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 800/1618] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:38.927175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.936870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f80d7-6360-4b92-b815-1bccb383b8b1 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.943382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.944172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.944939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.945346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.945968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.946272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.947425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.948248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.957694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 819/1619] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:38.958505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.963268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 801/1620] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:38.963268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:38.965240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:38.968895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec154c49-d00a-4fc1-bd74-4f6dfbf33951 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.975269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.976035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.976321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.976597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.977416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.978891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921defbe-bf08-4d99-a310-35b113a889c8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:38.979512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:38.983297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:38.984241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:38.984835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:38.985347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:38.995890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:38.997362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.007760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 802/1621] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:39.011644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.017108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205c567-f25b-454f-b247-9f46afc23bd5 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.026714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.027432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.028031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.028319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.039180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.040621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.051242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 803/1622] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:39.058672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.070202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198949b1-41c3-4968-841a-4292c995f5ef service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.075256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.075991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.076275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.076553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.077286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.079366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.093997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 820/1623] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:38 2022] POST /identity/v3/users => generated 308 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:39.093997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.103307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7c9e0-ba1d-438c-a849-9ec820874709 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.108404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.109141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.114899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.114899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.114899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.114899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.171783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 804/1624] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:39 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:39.173790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.213576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:39.220516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 821/1625] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:39 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:39.220516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.232333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7ceeb-4f5d-4ee7-8de7-08e115b38169 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.263711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba31951-f436-4e67-989d-df51303195b8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.270771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.271816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.272876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.273409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] PATH_INFO: `/v3/projects/a7572eee753249a8a6b73ba7731a72b7/users/a26f6ef3f5ea4bddbdbc1aca8dc399af/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.276557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7572eee753249a8a6b73ba7731a72b7, user_id=a26f6ef3f5ea4bddbdbc1aca8dc399af, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.280524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.307708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 805/1626] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:39 2022] PUT /identity/v3/projects/a7572eee753249a8a6b73ba7731a72b7/users/a26f6ef3f5ea4bddbdbc1aca8dc399af/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:39.308604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.314828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:39.354957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.355713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.355990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.356189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.356889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.358805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.371111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 822/1627] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:39.371806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.391029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c6bed-a0b5-4f4b-b146-7e52815d33c2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.391178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46629d-f10f-492a-bb54-b096cee6a789 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.397432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4567675-c18c-42c3-aaf5-e673a4a31756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.397898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.398214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567675-c18c-42c3-aaf5-e673a4a31756 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.398359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.398444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.398609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567675-c18c-42c3-aaf5-e673a4a31756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.398724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.398878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4567675-c18c-42c3-aaf5-e673a4a31756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.399596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.400281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4567675-c18c-42c3-aaf5-e673a4a31756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.401897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.402022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4567675-c18c-42c3-aaf5-e673a4a31756 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.416925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 823/1628] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:39.418273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0067d-a5da-438a-bb80-fc06a9e6b88d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.418704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0067d-a5da-438a-bb80-fc06a9e6b88d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.418988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0067d-a5da-438a-bb80-fc06a9e6b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.452509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9fc0067d-a5da-438a-bb80-fc06a9e6b88d None None] MFA Rules not processed for user `a26f6ef3f5ea4bddbdbc1aca8dc399af`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:39.454129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9fc0067d-a5da-438a-bb80-fc06a9e6b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:39.510334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 806/1629] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:39 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:39.510875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.534384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5072a4-6241-4b80-bd90-95016ca59e6b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.541127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.542222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.542656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.543004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] PATH_INFO: `/v3/projects/879618ed0be64385896e4093dc4c7414/users/b89445d4119a48d494b68f52af0474f5/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.567054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 824/1630] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:39.567531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879618ed0be64385896e4093dc4c7414, user_id=b89445d4119a48d494b68f52af0474f5, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.568188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0067d-a5da-438a-bb80-fc06a9e6b88d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.574977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.582496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0067d-a5da-438a-bb80-fc06a9e6b88d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.587201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.588426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.588763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.589183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] PATH_INFO: `/v3/projects/52f168dad97c449fbaebbb669bb8dcc3/users/8b4a498e360342e6bb9649dbef5f6cf1/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.616042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f168dad97c449fbaebbb669bb8dcc3, user_id=8b4a498e360342e6bb9649dbef5f6cf1, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.620164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.652662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 807/1631] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:39 2022] PUT /identity/v3/projects/879618ed0be64385896e4093dc4c7414/users/b89445d4119a48d494b68f52af0474f5/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:39.653799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.710325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 825/1632] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:39 2022] PUT /identity/v3/projects/52f168dad97c449fbaebbb669bb8dcc3/users/8b4a498e360342e6bb9649dbef5f6cf1/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:39.711263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.763048 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff860b8-1402-4713-9217-e462365805c8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.797819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2e6344-4629-4820-bf05-01032d2238ca admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.803276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.804013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.804297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.804639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.807481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:39.836235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.837129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.837572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.837888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.838698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.840508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.856286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 808/1633] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:39.857366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.868961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986608-eb20-4773-ba51-9cd8029d096a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.873041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:39.876197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.877229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.877629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.878003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.879417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.881660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.892663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.900064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 809/1634] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:39.900216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.900854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.916970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a6b25d-11c3-46df-9e35-f3e829b7293e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.922276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 826/1635] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:39.923380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.928588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.934320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.934320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.934320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.934320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.935127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.947141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45cdc57-fa70-4e34-92c6-d79ba3bddb3a service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.952434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.953382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.953672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.953955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] PATH_INFO: `/v3/projects/5688466ca8784920b58a606022199412/users/d4a73b3963a7423a9f49533545c39cbc/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.956293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 810/1636] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:39.957857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:39.968607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59fcdb8-c5e7-41ac-8ba3-0fe48459d51d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:39.971199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5688466ca8784920b58a606022199412, user_id=d4a73b3963a7423a9f49533545c39cbc, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.974053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:39.974669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.974949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:39.975428 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:39.975719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] PATH_INFO: `/v3/projects/879618ed0be64385896e4093dc4c7414/users/b89445d4119a48d494b68f52af0474f5/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:39.977850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879618ed0be64385896e4093dc4c7414, user_id=b89445d4119a48d494b68f52af0474f5, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:39.980488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:39.992386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 811/1637] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:39 2022] PUT /identity/v3/projects/879618ed0be64385896e4093dc4c7414/users/b89445d4119a48d494b68f52af0474f5/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:39.993265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:40.057475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58adb473-ed6f-4026-9848-75a451216644 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:40.062254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:40.063134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.063419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:40.063685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] PATH_INFO: `/v3/users/ab05ad428bef4632bb0e78cbf427850a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:40.064878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab05ad428bef4632bb0e78cbf427850a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:40.065956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: WARNING py.warnings [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:24:40.065956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: warnings.warn(msg) Jul 18 06:24:40.065956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: Jul 18 06:24:40.068078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:40.116310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 827/1638] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:39 2022] PUT /identity/v3/projects/5688466ca8784920b58a606022199412/users/d4a73b3963a7423a9f49533545c39cbc/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:40.117818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:40.199437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518a648-5d66-4a43-9d1b-df38d059253a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:40.205024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872b95e4-b7ef-4bd9-b7a4-dfbdd0c9425f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:40.206003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b95e4-b7ef-4bd9-b7a4-dfbdd0c9425f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.209516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b95e4-b7ef-4bd9-b7a4-dfbdd0c9425f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:40.209516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872b95e4-b7ef-4bd9-b7a4-dfbdd0c9425f admin admin] PATH_INFO: `/v3/projects/52f168dad97c449fbaebbb669bb8dcc3/users/8b4a498e360342e6bb9649dbef5f6cf1/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:40.209516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b95e4-b7ef-4bd9-b7a4-dfbdd0c9425f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f168dad97c449fbaebbb669bb8dcc3, user_id=8b4a498e360342e6bb9649dbef5f6cf1, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:40.212435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872b95e4-b7ef-4bd9-b7a4-dfbdd0c9425f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:40.223618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 828/1639] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:40 2022] PUT /identity/v3/projects/52f168dad97c449fbaebbb669bb8dcc3/users/8b4a498e360342e6bb9649dbef5f6cf1/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:40.225017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c2a7-2784-4c54-9cf8-dfebd8ba9f57 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.225463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c2a7-2784-4c54-9cf8-dfebd8ba9f57 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:40.225595 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2c2a7-2784-4c54-9cf8-dfebd8ba9f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:40.255421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d5f2c2a7-2784-4c54-9cf8-dfebd8ba9f57 None None] MFA Rules not processed for user `b89445d4119a48d494b68f52af0474f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:40.257401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d5f2c2a7-2784-4c54-9cf8-dfebd8ba9f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:40.297402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab05ad428bef4632bb0e78cbf427850a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:40.326058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab05ad428bef4632bb0e78cbf427850a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:40.341075 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab05ad428bef4632bb0e78cbf427850a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:40.354145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 829/1640] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:40 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:40.355152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2c2a7-2784-4c54-9cf8-dfebd8ba9f57 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:40.388518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab05ad428bef4632bb0e78cbf427850a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:40.389987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-103e89b7-4a0f-4767-97dc-dd88d30be9ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab05ad428bef4632bb0e78cbf427850a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:40.401194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 812/1641] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:39 2022] DELETE /identity/v3/users/ab05ad428bef4632bb0e78cbf427850a => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:40.403517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda9f1-ed14-413f-b64f-f8532bbb0811 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.403962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda9f1-ed14-413f-b64f-f8532bbb0811 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:40.404395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda9f1-ed14-413f-b64f-f8532bbb0811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:40.412426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:40.442415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2c2a7-2784-4c54-9cf8-dfebd8ba9f57 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:40.450312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-76cda9f1-ed14-413f-b64f-f8532bbb0811 None None] MFA Rules not processed for user `8b4a498e360342e6bb9649dbef5f6cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:40.451947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-76cda9f1-ed14-413f-b64f-f8532bbb0811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:40.459148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:40.538323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:40.539329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.540194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:40.541302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:40.542785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:40.545704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:40.567345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 830/1642] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:40.567345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:40.569866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:40.605621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 813/1643] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:40.611792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.611989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:40.613551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:40.632791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:40.634457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:40.645907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 814/1644] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:40.646808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:40.648213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:40.663594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4873d-4696-4a54-8260-d911ce47d659 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:40.671647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:40.672932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.672932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:40.673313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] PATH_INFO: `/v3/projects/5688466ca8784920b58a606022199412/users/d4a73b3963a7423a9f49533545c39cbc/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:40.675868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5688466ca8784920b58a606022199412, user_id=d4a73b3963a7423a9f49533545c39cbc, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:40.679305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:40.695176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 815/1645] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:40 2022] PUT /identity/v3/projects/5688466ca8784920b58a606022199412/users/d4a73b3963a7423a9f49533545c39cbc/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:40.696209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:40.702001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:40.724101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcb080-1bf2-4d33-8abb-2a2327b84cfd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:40.831479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b8a8c-b762-41a8-b526-1845516bcc3a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:40.837189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8ce17-cd6b-4328-84e0-9877d211e363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:40.837928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ce17-cd6b-4328-84e0-9877d211e363 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:40.838360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ce17-cd6b-4328-84e0-9877d211e363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.147807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8ce17-cd6b-4328-84e0-9877d211e363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.148223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:41.148705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-33e8ce17-cd6b-4328-84e0-9877d211e363 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:41.150025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:41.150025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.150025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.150025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:41.150025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:41.150607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:41.150784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 816/1646] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:41.150784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:41.150784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:41.151197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8ce17-cd6b-4328-84e0-9877d211e363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:41.151197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8ce17-cd6b-4328-84e0-9877d211e363 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:41.151197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 831/1647] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:40 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:41.151197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:41.151197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.151197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.151896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] MFA Rules not processed for user `d4a73b3963a7423a9f49533545c39cbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:41.151896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:41.152156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f5a6bc-0cbc-45a6-83c6-ed1ce35b54db service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:41.152156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:41.152156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:41.152156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.152641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.261043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:41.262524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:41.266670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 832/1648] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:41.267595 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:41.272861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:41.292132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 817/1649] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:41.293068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:41.302851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999507a1-e411-427a-9651-2ab7810a3f96 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:41.306076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:41.317235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0dc912-6811-4618-912a-6a23625c05ee service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:41.323456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:41.323612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:41.324263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:41.324382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:41.324554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.324652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.324836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.324924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] PATH_INFO: `/v3/users/a55d7218269c4b7aad2fb29e6f0b8baf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.327251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55d7218269c4b7aad2fb29e6f0b8baf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:41.333252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:41.355058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:41.355821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:41.370981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 818/1650] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:41 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:41.397563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:41.399299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:41.414390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb5c7fd-4a2f-4848-9cd1-c4a3d8261a85 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:41.436697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:41.437853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:41.438224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.438579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] PATH_INFO: `/v3/users/63e8f6b8d22144ee9534cadbdcb06b20` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.446079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e8f6b8d22144ee9534cadbdcb06b20)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:41.448915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:41.797735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55d7218269c4b7aad2fb29e6f0b8baf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.820868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e8f6b8d22144ee9534cadbdcb06b20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.835297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e8f6b8d22144ee9534cadbdcb06b20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.857258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e8f6b8d22144ee9534cadbdcb06b20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.867995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55d7218269c4b7aad2fb29e6f0b8baf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.868725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55d7218269c4b7aad2fb29e6f0b8baf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.885899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55d7218269c4b7aad2fb29e6f0b8baf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.887088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55d7218269c4b7aad2fb29e6f0b8baf'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.903719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 833/1651] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:41 2022] DELETE /identity/v3/users/a55d7218269c4b7aad2fb29e6f0b8baf => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:41.904736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:41.906346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:41.927667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e8f6b8d22144ee9534cadbdcb06b20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.928821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-44d20388-7342-49c2-ba86-47c457aa685b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e8f6b8d22144ee9534cadbdcb06b20'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:41.939656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 819/1652] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:41 2022] DELETE /identity/v3/users/63e8f6b8d22144ee9534cadbdcb06b20 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:41.942752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb431f-ba59-49fe-890c-6ecb8cfc2e41 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:41.943228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb431f-ba59-49fe-890c-6ecb8cfc2e41 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:41.944552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb431f-ba59-49fe-890c-6ecb8cfc2e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:41.973726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6afb431f-ba59-49fe-890c-6ecb8cfc2e41 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:41.981092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6afb431f-ba59-49fe-890c-6ecb8cfc2e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:42.008074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:42.013931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d73ff-59c8-411f-ac2a-57a35f2d6d30 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:42.086667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 820/1653] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:42.088089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:42.088384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:42.088663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:42.094611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:42.112645 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:42.114346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:42.115956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:42.116313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:42.120874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:42.121085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:42.123499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:42.138005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 821/1654] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:42.214260 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:42.218690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:42.317982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:42.319766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:42.335089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddee07c-c99b-4fe7-a7f5-c919a8b03d4a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:42.354467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:42.357922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:42.357922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:42.358239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:42.364840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 834/1655] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:42.370202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:42.373169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:42.387039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:42.393272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1f3d5-9f6e-4308-a05d-33dd26c22d19 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:42.394761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:42.400343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:42.401188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:42.401579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:42.401952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:42.412783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:42.414380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:42.427811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 835/1656] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:42.428998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 822/1657] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:24:43.255758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:43.257303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:43.292681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a4251-27ce-49d6-91fb-2201f0449234 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:43.333986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:43.334440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:43.334731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:43.335023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] PATH_INFO: `/v3/projects/2ef040fcb9d4462db31faa18de2f0876` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:43.339496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef040fcb9d4462db31faa18de2f0876)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:43.340098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: WARNING py.warnings [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 06:24:43.340098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: warnings.warn(msg) Jul 18 06:24:43.340098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: Jul 18 06:24:43.341462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:43.630996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef040fcb9d4462db31faa18de2f0876', 'request_id': 'req-81076a67-0251-46ee-8998-a95c43f70807'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:43.638931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef040fcb9d4462db31faa18de2f0876', 'request_id': 'req-81076a67-0251-46ee-8998-a95c43f70807'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:43.691744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:43.693104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:43.718483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94d90c-bcfb-403f-a580-358f08174612 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:43.754170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef040fcb9d4462db31faa18de2f0876', 'request_id': 'req-81076a67-0251-46ee-8998-a95c43f70807'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:43.805125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] The token cache is being invalidate because project 2ef040fcb9d4462db31faa18de2f0876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:43.806582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:43.807363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:43.813890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 836/1658] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:43 2022] DELETE /identity/v3/projects/2ef040fcb9d4462db31faa18de2f0876 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:43.819059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:43.821155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:43.870072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:43.876472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:43.877394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:43.877692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:43.878029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] PATH_INFO: `/v3/projects/8deff878f0b64c749b882ec6501d62eb` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:43.883150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8deff878f0b64c749b882ec6501d62eb)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:43.885140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:43.938666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81076a67-0251-46ee-8998-a95c43f70807 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:43.951137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:43.952086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:43.952385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:43.953018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] PATH_INFO: `/v3/users/a26f6ef3f5ea4bddbdbc1aca8dc399af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:43.956297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26f6ef3f5ea4bddbdbc1aca8dc399af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:43.958921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:44.129718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8deff878f0b64c749b882ec6501d62eb', 'request_id': 'req-0490051d-e133-40d7-afb5-eeeee2cc66a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:44.148561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8deff878f0b64c749b882ec6501d62eb', 'request_id': 'req-0490051d-e133-40d7-afb5-eeeee2cc66a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:44.924798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8deff878f0b64c749b882ec6501d62eb', 'request_id': 'req-0490051d-e133-40d7-afb5-eeeee2cc66a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:44.951701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] The token cache is being invalidate because project 8deff878f0b64c749b882ec6501d62eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:44.952073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:44.952846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:44.955561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 823/1659] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:43 2022] DELETE /identity/v3/projects/8deff878f0b64c749b882ec6501d62eb => generated 0 bytes in 1266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:24:44.956905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:44.958590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:44.983954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26f6ef3f5ea4bddbdbc1aca8dc399af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:44.984898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:45.062291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26f6ef3f5ea4bddbdbc1aca8dc399af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.062922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26f6ef3f5ea4bddbdbc1aca8dc399af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.087503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26f6ef3f5ea4bddbdbc1aca8dc399af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.089429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26f6ef3f5ea4bddbdbc1aca8dc399af'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.110234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0490051d-e133-40d7-afb5-eeeee2cc66a3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:45.125062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 837/1660] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:43 2022] DELETE /identity/v3/users/a26f6ef3f5ea4bddbdbc1aca8dc399af => generated 0 bytes in 1304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:45.125062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:45.125062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:45.129821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:45.130935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:45.131352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:45.131758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] PATH_INFO: `/v3/projects/5c7f4041159f4c95ae01378d3e9b7cc0` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:45.136247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7f4041159f4c95ae01378d3e9b7cc0)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:45.136883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:45.234610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291dfc49-bbad-4d98-8bbf-28870f4139d4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:45.242223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:45.243412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:45.243917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:45.244369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] PATH_INFO: `/v3/users/8b4a498e360342e6bb9649dbef5f6cf1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:45.245990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4a498e360342e6bb9649dbef5f6cf1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:45.248335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:45.348918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7f4041159f4c95ae01378d3e9b7cc0', 'request_id': 'req-37260de4-ea4e-4396-b88d-2dbcab88efdd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.364136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7f4041159f4c95ae01378d3e9b7cc0', 'request_id': 'req-37260de4-ea4e-4396-b88d-2dbcab88efdd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.469649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7f4041159f4c95ae01378d3e9b7cc0', 'request_id': 'req-37260de4-ea4e-4396-b88d-2dbcab88efdd'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.498396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] The token cache is being invalidate because project 5c7f4041159f4c95ae01378d3e9b7cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:45.498773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.504196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.506212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 824/1661] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:44 2022] DELETE /identity/v3/projects/5c7f4041159f4c95ae01378d3e9b7cc0 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:45.515538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:45.520217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4a498e360342e6bb9649dbef5f6cf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.520345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:45.619989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4a498e360342e6bb9649dbef5f6cf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.622128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4a498e360342e6bb9649dbef5f6cf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.677589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4a498e360342e6bb9649dbef5f6cf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.682419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4a498e360342e6bb9649dbef5f6cf1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:45.689994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37260de4-ea4e-4396-b88d-2dbcab88efdd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:45.712572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:45.715291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:45.717173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:45.717470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] PATH_INFO: `/v3/users/b89445d4119a48d494b68f52af0474f5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:45.723464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b89445d4119a48d494b68f52af0474f5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:45.731175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:45.733311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 838/1662] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:45 2022] DELETE /identity/v3/users/8b4a498e360342e6bb9649dbef5f6cf1 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:46.013681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b89445d4119a48d494b68f52af0474f5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:46.035538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b89445d4119a48d494b68f52af0474f5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:46.062741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b89445d4119a48d494b68f52af0474f5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:46.188721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b89445d4119a48d494b68f52af0474f5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:46.195909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b89445d4119a48d494b68f52af0474f5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:46.200126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 825/1663] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:45 2022] DELETE /identity/v3/users/b89445d4119a48d494b68f52af0474f5 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:46.273041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:46.726640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:46.756431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:46.758280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:46.873545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55239f6-80cb-4791-acc7-f4cb59cb92eb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:46.990243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:46.990243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:47.014585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:47.016940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.018568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.018568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] PATH_INFO: `/v3/projects/a7572eee753249a8a6b73ba7731a72b7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.020263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7572eee753249a8a6b73ba7731a72b7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:47.023090 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:47.184389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333d7f7-996f-4301-a187-ae4b40173835 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:47.209134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7572eee753249a8a6b73ba7731a72b7', 'request_id': 'req-e21b8837-7603-44c6-8fe3-249478dc8496'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.230794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7572eee753249a8a6b73ba7731a72b7', 'request_id': 'req-e21b8837-7603-44c6-8fe3-249478dc8496'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.303582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:47.310434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.310434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.310434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] PATH_INFO: `/v3/projects/52f168dad97c449fbaebbb669bb8dcc3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.310434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f168dad97c449fbaebbb669bb8dcc3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:47.310434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:47.361374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7572eee753249a8a6b73ba7731a72b7', 'request_id': 'req-e21b8837-7603-44c6-8fe3-249478dc8496'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.394558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] The token cache is being invalidate because project a7572eee753249a8a6b73ba7731a72b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:47.396127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.397636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e21b8837-7603-44c6-8fe3-249478dc8496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.401676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 839/1664] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:46 2022] DELETE /identity/v3/projects/a7572eee753249a8a6b73ba7731a72b7 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:47.409336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.413807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.413807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.466135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:47.468852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:47.501991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 840/1665] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:47.506769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:47.514462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:47.541073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f168dad97c449fbaebbb669bb8dcc3', 'request_id': 'req-d78ed7de-99c8-4acd-ac63-00e4f69e063a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.547115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079b312-c4b4-423c-aef1-e904e86e793f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:47.547641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f168dad97c449fbaebbb669bb8dcc3', 'request_id': 'req-d78ed7de-99c8-4acd-ac63-00e4f69e063a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.605007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f168dad97c449fbaebbb669bb8dcc3', 'request_id': 'req-d78ed7de-99c8-4acd-ac63-00e4f69e063a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.623975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] The token cache is being invalidate because project 52f168dad97c449fbaebbb669bb8dcc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:47.625208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.628060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d78ed7de-99c8-4acd-ac63-00e4f69e063a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.634692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 826/1666] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:46 2022] DELETE /identity/v3/projects/52f168dad97c449fbaebbb669bb8dcc3 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:24:47.636287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e98cbc-ea54-4893-81c3-b3957fbf5f1e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.636739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e98cbc-ea54-4893-81c3-b3957fbf5f1e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.637207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e98cbc-ea54-4893-81c3-b3957fbf5f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.686871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-62e98cbc-ea54-4893-81c3-b3957fbf5f1e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:47.688343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62e98cbc-ea54-4893-81c3-b3957fbf5f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:47.724549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:47.725476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.725765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.726047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] PATH_INFO: `/v3/projects/879618ed0be64385896e4093dc4c7414` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.729827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879618ed0be64385896e4093dc4c7414)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:47.736389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:47.781877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 827/1667] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:47.783447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949d244-5e0d-4a93-9711-438e5337d4fc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.783910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949d244-5e0d-4a93-9711-438e5337d4fc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.784350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949d244-5e0d-4a93-9711-438e5337d4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.810439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e949d244-5e0d-4a93-9711-438e5337d4fc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:47.812257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e949d244-5e0d-4a93-9711-438e5337d4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:47.835765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 828/1668] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:47.840910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949d244-5e0d-4a93-9711-438e5337d4fc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:47.850940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949d244-5e0d-4a93-9711-438e5337d4fc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:47.856652 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238de5ed-4790-413d-957f-154af15e07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:47.857684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238de5ed-4790-413d-957f-154af15e07b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.858165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238de5ed-4790-413d-957f-154af15e07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.858649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238de5ed-4790-413d-957f-154af15e07b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.860415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238de5ed-4790-413d-957f-154af15e07b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:47.860970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238de5ed-4790-413d-957f-154af15e07b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:47.863690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238de5ed-4790-413d-957f-154af15e07b2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:47.891330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 829/1669] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:47.893367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6fc4-9be1-4e12-a9a0-f3026f83f720 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:47.894653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6fc4-9be1-4e12-a9a0-f3026f83f720 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:47.895417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a6fc4-9be1-4e12-a9a0-f3026f83f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:47.921253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ec0a6fc4-9be1-4e12-a9a0-f3026f83f720 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:47.921600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ec0a6fc4-9be1-4e12-a9a0-f3026f83f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:47.948682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879618ed0be64385896e4093dc4c7414', 'request_id': 'req-97919c8f-3cc3-4138-806e-4086fdcd9b93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:47.965229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879618ed0be64385896e4093dc4c7414', 'request_id': 'req-97919c8f-3cc3-4138-806e-4086fdcd9b93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:48.005732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 830/1670] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:48.007238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6fc4-9be1-4e12-a9a0-f3026f83f720 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.025949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a6fc4-9be1-4e12-a9a0-f3026f83f720 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.039617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879618ed0be64385896e4093dc4c7414', 'request_id': 'req-97919c8f-3cc3-4138-806e-4086fdcd9b93'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:48.040086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473665a-acc2-491b-bfa1-81d4650e4682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.040925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473665a-acc2-491b-bfa1-81d4650e4682 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.041485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473665a-acc2-491b-bfa1-81d4650e4682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.042249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473665a-acc2-491b-bfa1-81d4650e4682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.043172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473665a-acc2-491b-bfa1-81d4650e4682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.045961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473665a-acc2-491b-bfa1-81d4650e4682 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.059051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] The token cache is being invalidate because project 879618ed0be64385896e4093dc4c7414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:48.059355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:48.060335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:48.069075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 841/1671] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:47 2022] DELETE /identity/v3/projects/879618ed0be64385896e4093dc4c7414 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:48.069075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.072029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:48.078214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:48.100638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97919c8f-3cc3-4138-806e-4086fdcd9b93 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.105668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.106378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.106674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.106945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.108650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:48.108650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.109780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.135140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 831/1672] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:48 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:48.136600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d19da-8e6f-449b-b4e0-3038e7013d36 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.136892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d19da-8e6f-449b-b4e0-3038e7013d36 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.139379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666d19da-8e6f-449b-b4e0-3038e7013d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.150359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 842/1673] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:48.150359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.150359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:48.180729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0881-4c15-4398-a145-322bed339428 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.190110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-666d19da-8e6f-449b-b4e0-3038e7013d36 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:48.194605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-666d19da-8e6f-449b-b4e0-3038e7013d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:48.291224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de980ae-852e-4afe-b83f-6b30e53acd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.292998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de980ae-852e-4afe-b83f-6b30e53acd6d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.294814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de980ae-852e-4afe-b83f-6b30e53acd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.295331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de980ae-852e-4afe-b83f-6b30e53acd6d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.296262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de980ae-852e-4afe-b83f-6b30e53acd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.299809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de980ae-852e-4afe-b83f-6b30e53acd6d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.330255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 832/1674] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:48.331212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d19da-8e6f-449b-b4e0-3038e7013d36 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.342503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666d19da-8e6f-449b-b4e0-3038e7013d36 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.348927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.349860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.350262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.350651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.351475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.353605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.393888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 843/1675] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:48 2022] POST /identity/v3/users => generated 286 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:48.395444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0b54-63a2-4426-b9c3-408ecd2d3663 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.398101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0b54-63a2-4426-b9c3-408ecd2d3663 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.398664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae0b54-63a2-4426-b9c3-408ecd2d3663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.411746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:48.427711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-32ae0b54-63a2-4426-b9c3-408ecd2d3663 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:48.429698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-32ae0b54-63a2-4426-b9c3-408ecd2d3663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:48.442676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 844/1676] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:48.443843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae0b54-63a2-4426-b9c3-408ecd2d3663 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.454331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae0b54-63a2-4426-b9c3-408ecd2d3663 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.460337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.461592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.462258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.462787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.464471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.476315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.479581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 833/1677] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:48 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:48.480675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.508468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 845/1678] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:48.509776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.539152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66948f0d-86c6-467b-b428-a6ca64e31c0c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.632067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdbe7a-2c13-4a70-8996-da71df9e2819 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.644810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.648080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.648080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.648080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.652031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:48.653197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.668117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.693722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 834/1679] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:48.696617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.700716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.700716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.700716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.701075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.701588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.703570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.713647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aa5fa-1746-4e94-9ec6-a14b4f300ca9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.720235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.722919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.723711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.724439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.726264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.729316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.766592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 835/1680] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:48.769452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.783308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7318172a-1107-41a4-9c0e-543cadd0adf8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.790988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.792915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.793476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.794024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.795196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.798516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:48.886666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 846/1681] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:48 2022] POST /identity/v3/users => generated 291 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:48.888953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.912562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b82438-be12-44ed-9c0f-ceb752770234 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:48.932664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:48.934067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:48.934501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:48.934942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] PATH_INFO: `/v3/projects/f08dec7e92314bdfa62591e81474e6c7/users/db653afbffd0474d879b057e9d9206dd/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:48.953242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 836/1682] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:48 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:48.954474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:48.960019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f08dec7e92314bdfa62591e81474e6c7, user_id=db653afbffd0474d879b057e9d9206dd, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:48.963161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.059317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 847/1683] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:48 2022] PUT /identity/v3/projects/f08dec7e92314bdfa62591e81474e6c7/users/db653afbffd0474d879b057e9d9206dd/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:49.060823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.072882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af9147-dd18-47de-856c-195ec5ed19b8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.181720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1d1b3-1157-4e21-b1ca-b36003b238fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.182791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1d1b3-1157-4e21-b1ca-b36003b238fe admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.183211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1d1b3-1157-4e21-b1ca-b36003b238fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.183645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1d1b3-1157-4e21-b1ca-b36003b238fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.184820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1d1b3-1157-4e21-b1ca-b36003b238fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.188208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1d1b3-1157-4e21-b1ca-b36003b238fe admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.205523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 837/1684] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:49.208515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b7a-0352-4392-b33b-8350a7a9b167 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.208972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b7a-0352-4392-b33b-8350a7a9b167 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.209894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5b7a-0352-4392-b33b-8350a7a9b167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.230367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32ca34-bd53-41df-abcb-e74130adfecc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.241158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.242083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.242578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.242997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.244467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-80bd5b7a-0352-4392-b33b-8350a7a9b167 None None] MFA Rules not processed for user `db653afbffd0474d879b057e9d9206dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:49.246223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-80bd5b7a-0352-4392-b33b-8350a7a9b167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:49.253028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.253028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.370648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 848/1685] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:49 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:49.371596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.374238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 838/1686] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:49.377290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5b7a-0352-4392-b33b-8350a7a9b167 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.402107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5b7a-0352-4392-b33b-8350a7a9b167 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.407142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c0ba2-2048-49ac-ad81-6d37a994ad00 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.414374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.415514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.416069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.416434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.418015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.419970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.432431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.433137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.433420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.433696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.434431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.436030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.436568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 839/1687] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:49.438035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.440542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:49.479119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 849/1688] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:49.480097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.499081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148836d1-b6ab-4b10-bd41-aaba8f612fd8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.514682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.515366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.515649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.515938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.516655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.518289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.543903 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 850/1689] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:49.544806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.555392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb7acb-bc4c-4379-b869-b7278cad7f7f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.561635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.566985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.568127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2b08-c8c4-4d37-bc37-3f132af13d7d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.570588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.574647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.582130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.583408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.583691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.583965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] PATH_INFO: `/v3/projects/29480ece55764e969c59aa2bd3519897/users/76a5d636c59a4582aa0ecea364bdeab7/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.607850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.615897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.615981 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29480ece55764e969c59aa2bd3519897, user_id=76a5d636c59a4582aa0ecea364bdeab7, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.618619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.637172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 840/1690] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:49.650528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.658843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c91af6-68f2-4b9b-b700-1ea086fb4c7c service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.672687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b54c0c-83c6-4f6f-aa2b-f67f180aa4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.673938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54c0c-83c6-4f6f-aa2b-f67f180aa4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.674368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54c0c-83c6-4f6f-aa2b-f67f180aa4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.676470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b54c0c-83c6-4f6f-aa2b-f67f180aa4b0 admin admin] PATH_INFO: `/v3/projects/2b08df94a2fd4f06a34457851e91dabe/users/e8c3cc1f04e64628adbda938898ddf78/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.698658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:49.716917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b54c0c-83c6-4f6f-aa2b-f67f180aa4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b08df94a2fd4f06a34457851e91dabe, user_id=e8c3cc1f04e64628adbda938898ddf78, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.720613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b54c0c-83c6-4f6f-aa2b-f67f180aa4b0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.731674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 851/1691] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:49 2022] PUT /identity/v3/projects/29480ece55764e969c59aa2bd3519897/users/76a5d636c59a4582aa0ecea364bdeab7/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:49.743617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:49.865442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de7e88-0755-4f54-8a37-f1b70b86abd2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:49.878910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:49.880420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.880711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.881007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] PATH_INFO: `/v3/users/db653afbffd0474d879b057e9d9206dd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.882695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] RBAC: Authorizing `identity:delete_user(user_id=db653afbffd0474d879b057e9d9206dd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:49.895411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 841/1692] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:49 2022] PUT /identity/v3/projects/2b08df94a2fd4f06a34457851e91dabe/users/e8c3cc1f04e64628adbda938898ddf78/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:49.896480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23590c8-3dc9-4cb2-a0ae-b725c208bad5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:49.897677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23590c8-3dc9-4cb2-a0ae-b725c208bad5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:49.899357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23590c8-3dc9-4cb2-a0ae-b725c208bad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:49.900899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:49.983082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a23590c8-3dc9-4cb2-a0ae-b725c208bad5 None None] MFA Rules not processed for user `76a5d636c59a4582aa0ecea364bdeab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:49.984637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a23590c8-3dc9-4cb2-a0ae-b725c208bad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:50.164745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 842/1693] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:50.171503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d15e74-6b12-4b4a-a280-472e2374de53 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:50.171503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d15e74-6b12-4b4a-a280-472e2374de53 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:50.171503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d15e74-6b12-4b4a-a280-472e2374de53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:50.227714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-21d15e74-6b12-4b4a-a280-472e2374de53 None None] MFA Rules not processed for user `e8c3cc1f04e64628adbda938898ddf78`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:50.229473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-21d15e74-6b12-4b4a-a280-472e2374de53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:50.257819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db653afbffd0474d879b057e9d9206dd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:50.331037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db653afbffd0474d879b057e9d9206dd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:50.332649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db653afbffd0474d879b057e9d9206dd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:50.355462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db653afbffd0474d879b057e9d9206dd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:50.357790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db653afbffd0474d879b057e9d9206dd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:50.388993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 852/1694] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:49 2022] DELETE /identity/v3/users/db653afbffd0474d879b057e9d9206dd => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:50.390409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:50.393193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:50.395159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 843/1695] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:50.396694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:50.397007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:50.399098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:50.467105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:50.470622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:50.498234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:50.580155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f853e45-c7f9-4735-afb3-8ec693179fff admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:50.590260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:50.593774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:50.593774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:50.593774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:50.593774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:50.595207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:50.626063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 844/1696] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:50.628700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:50.631136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:50.660809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55406f0-aa51-4a7f-8a4c-b242bfa2c1db None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:50.668957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:50.670028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:50.670476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:50.670909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:50.671910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:50.676839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:50.711437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 853/1697] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:50 2022] POST /identity/v3/projects => generated 377 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:50.713010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:50.720610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:50.806515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 845/1698] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:50 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:50.808779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:50.925849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7eb4d-7345-404d-a8dd-efd7225fcdf1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:50.981197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f54204-4ed6-4ef8-9941-9e3a7a734761 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:50.994394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:50.995304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:50.995687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:50.996100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:50.996909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:50.999102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.025007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.026354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.026354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.026354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.041000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.043473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.064157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 854/1699] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:51.065055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.078040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd988a-7ccf-41ed-bc5a-00bab5ae2143 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.086543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.087314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.087649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.087925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.088797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.091080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.115233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 846/1700] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:50 2022] POST /identity/v3/users => generated 295 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:51.121354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.134716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873a790-5e58-45ad-913c-20270e01b0fd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.144871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.146117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.146596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.147205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.148368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.151535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.181797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 855/1701] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:51 2022] POST /identity/v3/users => generated 297 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:51.181797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.201715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 847/1702] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:51.203165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.222446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3585f-c15a-4221-b650-3730e382bfab admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.236080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.238844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.243153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf927f-6980-4766-9afc-ce286cb6ef39 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.248335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.248335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.248335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.248335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.268056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.270335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.270335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.270335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] PATH_INFO: `/v3/projects/6744bd70d53d4baaaecddb0c392d8ac8/users/4c7317aac245407ea646e253acaf9a05/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.296173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 856/1703] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:51.296173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.316550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78811a-6a40-4d80-bfab-d15792d5919d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.324733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.326208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.326673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.326924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] PATH_INFO: `/v3/projects/538ca3d961d049959bd5a6cd7666bd4f/users/8e56161db1a24ac9844d5aafd0ae0899/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.349528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538ca3d961d049959bd5a6cd7666bd4f, user_id=8e56161db1a24ac9844d5aafd0ae0899, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.352254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.353976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6744bd70d53d4baaaecddb0c392d8ac8, user_id=4c7317aac245407ea646e253acaf9a05, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.357041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.421805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 857/1704] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:51 2022] PUT /identity/v3/projects/538ca3d961d049959bd5a6cd7666bd4f/users/8e56161db1a24ac9844d5aafd0ae0899/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:51.426433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.452937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:51.463287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 848/1705] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:51 2022] PUT /identity/v3/projects/6744bd70d53d4baaaecddb0c392d8ac8/users/4c7317aac245407ea646e253acaf9a05/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:51.464219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.536012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839a7ec-c4e8-4d75-8e0b-657dbd2e7111 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.543071 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:51.630000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.630787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.631155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.631418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.632581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.635053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.650094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 858/1706] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:24:51.655371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.667222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a01719-cca6-4377-b026-e22ff539b261 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.678391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801bfe3-96f9-4e68-b573-6aaaf2d97672 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.684410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.685325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.685592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b23a8-2f25-4465-9594-e329cddb0934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.685724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.685866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.686611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.686717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b23a8-2f25-4465-9594-e329cddb0934 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.687139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b23a8-2f25-4465-9594-e329cddb0934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.687803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b23a8-2f25-4465-9594-e329cddb0934 admin admin] PATH_INFO: `/v3/projects/538ca3d961d049959bd5a6cd7666bd4f/users/8e56161db1a24ac9844d5aafd0ae0899/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.688241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.692708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b23a8-2f25-4465-9594-e329cddb0934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538ca3d961d049959bd5a6cd7666bd4f, user_id=8e56161db1a24ac9844d5aafd0ae0899, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.701943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b23a8-2f25-4465-9594-e329cddb0934 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:51.726082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 849/1707] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:51 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:51.727072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:51.741697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 859/1708] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:51 2022] PUT /identity/v3/projects/538ca3d961d049959bd5a6cd7666bd4f/users/8e56161db1a24ac9844d5aafd0ae0899/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:51.752492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27470c-b2e4-43a5-8fd7-fe51ff589099 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.757049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27470c-b2e4-43a5-8fd7-fe51ff589099 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.757049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee27470c-b2e4-43a5-8fd7-fe51ff589099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.764739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d45b1-3cce-441b-872f-663dcb938f45 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:51.808691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ee27470c-b2e4-43a5-8fd7-fe51ff589099 None None] MFA Rules not processed for user `8e56161db1a24ac9844d5aafd0ae0899`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:51.811528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee27470c-b2e4-43a5-8fd7-fe51ff589099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:51.956700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:51.957804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:51.958090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:51.958405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] PATH_INFO: `/v3/projects/6744bd70d53d4baaaecddb0c392d8ac8/users/4c7317aac245407ea646e253acaf9a05/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:51.967419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6744bd70d53d4baaaecddb0c392d8ac8, user_id=4c7317aac245407ea646e253acaf9a05, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:51.970426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:52.011448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 860/1710] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:24:52.016475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:52.017027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:52.017475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:52.019716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 850/1710] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:51 2022] PUT /identity/v3/projects/6744bd70d53d4baaaecddb0c392d8ac8/users/4c7317aac245407ea646e253acaf9a05/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:52.043639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:52.046153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:52.078414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] MFA Rules not processed for user `4c7317aac245407ea646e253acaf9a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:52.083380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:52.209782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941463c4-8950-42d2-aac5-33ac6a38ef40 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:52.227797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a60c63-58ef-49c2-be5f-6c6b7bc95c30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:52.227797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a60c63-58ef-49c2-be5f-6c6b7bc95c30 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:52.227797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a60c63-58ef-49c2-be5f-6c6b7bc95c30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:52.228105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a60c63-58ef-49c2-be5f-6c6b7bc95c30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:52.331769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 861/1711] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:52.349267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:52.351192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:52.383297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d4e01-691b-4062-9ab5-61e9d9115192 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:52.397821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:52.398581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:52.398873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:52.399146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:52.417266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a60c63-58ef-49c2-be5f-6c6b7bc95c30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:52.419072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a60c63-58ef-49c2-be5f-6c6b7bc95c30 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:52.437069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:52.440498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:52.449134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 851/1712] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:52.480373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 862/1713] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:52.613143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c032e1-10e1-4236-8858-96b8234319c0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:52.613818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c032e1-10e1-4236-8858-96b8234319c0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:52.614327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c032e1-10e1-4236-8858-96b8234319c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:52.655221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-56c032e1-10e1-4236-8858-96b8234319c0 None None] MFA Rules not processed for user `1c4e450af95547bc9c633612b110858e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:52.656814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-56c032e1-10e1-4236-8858-96b8234319c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:52.698813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:52.701160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:52.728884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:52.811074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:52.901196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 852/1714] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:52.918835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a664141-0dd8-4e66-a2c3-0b9976002eff None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:52.919256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a664141-0dd8-4e66-a2c3-0b9976002eff None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:52.919411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a664141-0dd8-4e66-a2c3-0b9976002eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:52.971532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6a664141-0dd8-4e66-a2c3-0b9976002eff None None] MFA Rules not processed for user `1c4e450af95547bc9c633612b110858e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:52.979297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f42ed-d0be-48f0-a1a1-c1e3da414d81 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:52.981152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6a664141-0dd8-4e66-a2c3-0b9976002eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:52.996390 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:52.997718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:52.998173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:52.998279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 853/1715] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:52.998843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] PATH_INFO: `/v3/projects/f08dec7e92314bdfa62591e81474e6c7` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.002169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f08dec7e92314bdfa62591e81474e6c7)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:53.003593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a664141-0dd8-4e66-a2c3-0b9976002eff None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:53.006820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:53.028208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a664141-0dd8-4e66-a2c3-0b9976002eff None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:53.041916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfae71a8-6f37-47e1-93d0-fb7aca841008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:53.041916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae71a8-6f37-47e1-93d0-fb7aca841008 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.041916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae71a8-6f37-47e1-93d0-fb7aca841008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.041916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfae71a8-6f37-47e1-93d0-fb7aca841008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.200730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f08dec7e92314bdfa62591e81474e6c7', 'request_id': 'req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:53.215449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f08dec7e92314bdfa62591e81474e6c7', 'request_id': 'req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:53.225470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae71a8-6f37-47e1-93d0-fb7aca841008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:53.226840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfae71a8-6f37-47e1-93d0-fb7aca841008 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:53.239940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 854/1716] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:53.241654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba240-e7da-4ad8-b3a7-34d154b321c0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.242292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba240-e7da-4ad8-b3a7-34d154b321c0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.242786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fba240-e7da-4ad8-b3a7-34d154b321c0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.244891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 855/1717] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 18 06:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:24:53.252080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295386-2d5d-4e26-b8f2-643d9ee85475 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.252553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295386-2d5d-4e26-b8f2-643d9ee85475 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.254450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c295386-2d5d-4e26-b8f2-643d9ee85475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.310540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f08dec7e92314bdfa62591e81474e6c7', 'request_id': 'req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:53.317407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3c295386-2d5d-4e26-b8f2-643d9ee85475 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:53.324439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3c295386-2d5d-4e26-b8f2-643d9ee85475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:53.336743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] The token cache is being invalidate because project f08dec7e92314bdfa62591e81474e6c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:53.337317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:53.346191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d350c2f5-c41a-4775-bd97-49bddfb3f6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:53.355842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 863/1718] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:52 2022] DELETE /identity/v3/projects/f08dec7e92314bdfa62591e81474e6c7 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:53.358605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea23ed4-1285-4aea-83ef-b17aa1402b25 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.361150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea23ed4-1285-4aea-83ef-b17aa1402b25 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.363753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea23ed4-1285-4aea-83ef-b17aa1402b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.431524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0ea23ed4-1285-4aea-83ef-b17aa1402b25 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:53.433194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0ea23ed4-1285-4aea-83ef-b17aa1402b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:53.495497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 856/1719] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 18 06:24:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:53.511953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295386-2d5d-4e26-b8f2-643d9ee85475 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:53.529971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c295386-2d5d-4e26-b8f2-643d9ee85475 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:53.539917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:53.559180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.559523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.559988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.566346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:53.609668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 864/1720] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:53.614668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478734-fa7c-4d65-a046-8d9e8aea6ee7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.614965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478734-fa7c-4d65-a046-8d9e8aea6ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.617114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01478734-fa7c-4d65-a046-8d9e8aea6ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.664858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-01478734-fa7c-4d65-a046-8d9e8aea6ee7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:53.666125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-01478734-fa7c-4d65-a046-8d9e8aea6ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:53.688184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 865/1721] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:53.689474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478734-fa7c-4d65-a046-8d9e8aea6ee7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:53.711767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01478734-fa7c-4d65-a046-8d9e8aea6ee7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:53.728606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:53.729662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.729992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.730379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.731279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:53.731712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:53.733758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:53.744705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:53.746569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:53.764892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 857/1722] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:53.767550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 866/1723] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:53.768550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:53.784159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815a219-05f9-4299-b806-e56093b9962f service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:53.790780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:53.791717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:53.792196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:53.792583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:53.793474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:53.795701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:53.932289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 858/1724] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:53 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:53.937324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:53.952905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5017654-bcbd-4829-80bb-6d3f66de4dd4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:54.028656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:54.089647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:54.090573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.091021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.091441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.092301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:54.095123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:54.221019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:54.221888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 867/1725] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:24:53 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:54.234208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f378a7-1d3e-4161-a9fe-d3c4fdb9afb2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:54.267401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:54.268133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.268419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.269853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.275845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:54.277540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:54.299622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 859/1726] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:54.303368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:54.318767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dfb9b-2ef4-4f2b-aefe-4f60c0795446 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:54.330437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fac82-c239-46f8-a3d0-0134a38242ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:54.332005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fac82-c239-46f8-a3d0-0134a38242ba admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.332441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fac82-c239-46f8-a3d0-0134a38242ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.332870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fac82-c239-46f8-a3d0-0134a38242ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.334042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fac82-c239-46f8-a3d0-0134a38242ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:54.335804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fac82-c239-46f8-a3d0-0134a38242ba admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:54.370139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:54.375697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 868/1727] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:24:54.380476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897bfa-6025-46b5-8aea-bc8153003ee3 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.382996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38e1c-7468-4829-af93-44229a2c2549 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:54.384291 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897bfa-6025-46b5-8aea-bc8153003ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.385169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897bfa-6025-46b5-8aea-bc8153003ee3 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.389692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 869/1728] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 18 06:24:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:24:54.394525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967e538-90a9-4c35-8f2e-7b93261a954d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:54.394525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967e538-90a9-4c35-8f2e-7b93261a954d admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.394525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967e538-90a9-4c35-8f2e-7b93261a954d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.394525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967e538-90a9-4c35-8f2e-7b93261a954d admin admin] PATH_INFO: `/v3/projects/7298bf58b8b6472b9e68c7605b87c9da/users/605726dc1df1459c8e2f56faf0d7714c/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.397077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.397569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.398074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.431865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967e538-90a9-4c35-8f2e-7b93261a954d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7298bf58b8b6472b9e68c7605b87c9da, user_id=605726dc1df1459c8e2f56faf0d7714c, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:54.436270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2967e538-90a9-4c35-8f2e-7b93261a954d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:54.440426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:54.440426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:54.538094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 860/1729] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:24:54 2022] PUT /identity/v3/projects/7298bf58b8b6472b9e68c7605b87c9da/users/605726dc1df1459c8e2f56faf0d7714c/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:24:54.548499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.548796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.549721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.573215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 870/1730] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:24:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:24:54.590879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:54.595218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:54.608833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] MFA Rules not processed for user `605726dc1df1459c8e2f56faf0d7714c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:54.610584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:54.746325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 861/1731] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:54.758089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:54.759608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:54.783852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b44ae-d819-4ef0-89a1-f8cd06a6da92 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:54.840180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:54.856608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:54.857187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1459eb3-ad68-4d75-99c3-21935aa43691 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:54.857625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.858118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.858958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.862465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:54.864033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:54.864330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:54.865502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:54.880526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:54.882180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:54.896785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 862/1732] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:54.898251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:54.899861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:55.022088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:55.023024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd07d8c2-a16e-4c25-8a34-8c3f2491ccfc service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:55.024869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:55.031437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7317aac245407ea646e253acaf9a05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6744bd70d53d4baaaecddb0c392d8ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:55.036247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:55.036706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:55.037063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:55.039297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:55.040219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:55.045340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:55.058064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 871/1733] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:55.087406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 863/1734] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:55.091910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:55.114235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d3802-ab5b-44fa-a31e-5e6acc70ef9d service glance] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:55.126835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7317aac245407ea646e253acaf9a05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6744bd70d53d4baaaecddb0c392d8ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:55.127556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:55.127857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:55.128736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:55.129698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:55.150126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:55.190308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:55.276218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 872/1735] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:24:55 2022] POST /identity/v3/projects => generated 354 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:24:55.280545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:55.308657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467cb80-8fda-45a7-a43a-427b098e2447 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:55.481951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf027a6-8f9d-4a25-9a1b-558ae7b27e4d tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7317aac245407ea646e253acaf9a05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6744bd70d53d4baaaecddb0c392d8ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:55.482645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf027a6-8f9d-4a25-9a1b-558ae7b27e4d tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:55.482936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf027a6-8f9d-4a25-9a1b-558ae7b27e4d tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:55.483215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf027a6-8f9d-4a25-9a1b-558ae7b27e4d tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:55.484781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf027a6-8f9d-4a25-9a1b-558ae7b27e4d tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:24:55.484781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf027a6-8f9d-4a25-9a1b-558ae7b27e4d tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:55.489752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf027a6-8f9d-4a25-9a1b-558ae7b27e4d tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:55.515986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 864/1736] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:24:55.611653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:55.831777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:55.842092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7c11-fbff-4aee-91b9-1a1a54625465 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:55.842596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7c11-fbff-4aee-91b9-1a1a54625465 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:55.842670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef7c11-fbff-4aee-91b9-1a1a54625465 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:55.844201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 865/1737] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 18 06:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:24:55.847187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cd037b-03a0-41ae-ad3a-2c672ee7fca3 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:55.849791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:55.850151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:55.850572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:55.861664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c7317aac245407ea646e253acaf9a05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6744bd70d53d4baaaecddb0c392d8ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:55.865504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:55.865504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:55.865504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] PATH_INFO: `/v3/projects/069405a33df54eaf8dc955189330bdf1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:55.866086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorizing `identity:delete_project(project_id=069405a33df54eaf8dc955189330bdf1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:55.871740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:55.947142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] MFA Rules not processed for user `aff4923457aa4be498f954c73f4d0018`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:55.948168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:56.070843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 866/1738] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:24:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:24:56.085737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:56.087259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:56.097698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '069405a33df54eaf8dc955189330bdf1', 'request_id': 'req-ad5d343b-dd68-4214-93cc-ab2b6c24a430'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:56.104566 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '069405a33df54eaf8dc955189330bdf1', 'request_id': 'req-ad5d343b-dd68-4214-93cc-ab2b6c24a430'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:56.108598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeff29b-13bc-498b-93f3-945cbf97df4b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:56.137508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:56.207441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb2b6d-4aee-4e23-bbb1-4b815f54a612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:56.208115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2b6d-4aee-4e23-bbb1-4b815f54a612 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:56.208403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2b6d-4aee-4e23-bbb1-4b815f54a612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:56.208688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb2b6d-4aee-4e23-bbb1-4b815f54a612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:56.217692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb2b6d-4aee-4e23-bbb1-4b815f54a612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:56.219148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb2b6d-4aee-4e23-bbb1-4b815f54a612 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:56.228892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 867/1739] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:24:56.246392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '069405a33df54eaf8dc955189330bdf1', 'request_id': 'req-ad5d343b-dd68-4214-93cc-ab2b6c24a430'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:56.263520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] The token cache is being invalidate because project 069405a33df54eaf8dc955189330bdf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:24:56.264225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:56.265283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ad5d343b-dd68-4214-93cc-ab2b6c24a430 tempest-VolumeQuotaClassesTest-73950860 tempest-VolumeQuotaClassesTest-73950860-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:56.274830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 873/1740] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:24:55 2022] DELETE /identity/v3/projects/069405a33df54eaf8dc955189330bdf1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:56.373149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8343a-ec3f-4552-800d-cf059d6b44c4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:56.373458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8343a-ec3f-4552-800d-cf059d6b44c4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:56.373746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8343a-ec3f-4552-800d-cf059d6b44c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:56.454689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-87f8343a-ec3f-4552-800d-cf059d6b44c4 None None] MFA Rules not processed for user `4b57f9679e65450b9d97b0ce893fd6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:56.456222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-87f8343a-ec3f-4552-800d-cf059d6b44c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:56.655550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 868/1741] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:56.748759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685481-5964-4fb7-a7aa-b5812d68dd5d None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:56.749685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685481-5964-4fb7-a7aa-b5812d68dd5d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:56.750189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1685481-5964-4fb7-a7aa-b5812d68dd5d None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:56.752533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 874/1742] 10.222.0.27 () {54 vars in 962 bytes} [Mon Jul 18 06:24:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:24:56.768750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:56.769686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:56.770125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:56.795625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:56.808252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:56.810851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:56.951698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:57.028414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 869/1743] 10.222.0.27 () {58 vars in 1059 bytes} [Mon Jul 18 06:24:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:57.038309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1685481-5964-4fb7-a7aa-b5812d68dd5d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:57.070527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1685481-5964-4fb7-a7aa-b5812d68dd5d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:57.092723 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910af0d4-4f22-402b-aa34-114ff031ec56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:57.093624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af0d4-4f22-402b-aa34-114ff031ec56 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:57.094053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af0d4-4f22-402b-aa34-114ff031ec56 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:57.094474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910af0d4-4f22-402b-aa34-114ff031ec56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:57.118605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910af0d4-4f22-402b-aa34-114ff031ec56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:57.122426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910af0d4-4f22-402b-aa34-114ff031ec56 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:57.162050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 875/1744] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:57.480491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:57.482475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:57.655766 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018b45f-9b35-42fb-8e8b-520c9a697e96 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:57.666521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:57.669070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:57.679323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a058-9501-465e-9d78-0a976fdc9638 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:57.680236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a058-9501-465e-9d78-0a976fdc9638 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:57.680899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53a058-9501-465e-9d78-0a976fdc9638 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:57.688672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 876/1745] 10.222.0.27 () {54 vars in 961 bytes} [Mon Jul 18 06:24:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:24:57.692756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:57.695983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] PATH_INFO: `/v3/users/76a5d636c59a4582aa0ecea364bdeab7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:57.702026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77cedf-e700-4123-a05e-baed5e7d6ed2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:57.702593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77cedf-e700-4123-a05e-baed5e7d6ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:57.706721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee77cedf-e700-4123-a05e-baed5e7d6ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:57.709898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a5d636c59a4582aa0ecea364bdeab7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:57.716886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:57.756061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ee77cedf-e700-4123-a05e-baed5e7d6ed2 None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:57.765753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ee77cedf-e700-4123-a05e-baed5e7d6ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:57.964729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 877/1746] 10.222.0.27 () {58 vars in 1058 bytes} [Mon Jul 18 06:24:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 18 06:24:57.967089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2453-24ed-43c2-9aa2-4afc72a48abc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:57.967578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2453-24ed-43c2-9aa2-4afc72a48abc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:57.969135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae2453-24ed-43c2-9aa2-4afc72a48abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:58.014478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fbae2453-24ed-43c2-9aa2-4afc72a48abc None None] MFA Rules not processed for user `1c4e450af95547bc9c633612b110858e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:58.023481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fbae2453-24ed-43c2-9aa2-4afc72a48abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:58.080239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a5d636c59a4582aa0ecea364bdeab7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:58.124058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a5d636c59a4582aa0ecea364bdeab7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:58.157894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a5d636c59a4582aa0ecea364bdeab7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:58.167084 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:58.284814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 878/1747] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:58.287038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a5d636c59a4582aa0ecea364bdeab7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:58.287745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bedd4ff8-5d72-4cee-b09a-d24421daf0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a5d636c59a4582aa0ecea364bdeab7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:24:58.299290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 870/1748] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:24:57 2022] DELETE /identity/v3/users/76a5d636c59a4582aa0ecea364bdeab7 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:24:58.301509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae2453-24ed-43c2-9aa2-4afc72a48abc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:58.312701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:58.312701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:58.312701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:58.395392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae2453-24ed-43c2-9aa2-4afc72a48abc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:58.452758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:58.462391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:58.717187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:58.719994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44bd79-2211-4f94-b396-368acba55230 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:58.720608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44bd79-2211-4f94-b396-368acba55230 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:58.721092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44bd79-2211-4f94-b396-368acba55230 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:58.724164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44bd79-2211-4f94-b396-368acba55230 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:58.735710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ed44bd79-2211-4f94-b396-368acba55230 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:58.756721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 871/1749] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:58.761564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44bd79-2211-4f94-b396-368acba55230 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:58.764315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44bd79-2211-4f94-b396-368acba55230 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:58.779776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 879/1750] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:58.917828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:58.926837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:58.983820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:59.116634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8936fed-8aaa-48f9-86dc-cd0b183ab731 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:24:59.129716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3388ff-e555-4034-9d5f-c36fc1c440bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:24:59.130639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3388ff-e555-4034-9d5f-c36fc1c440bd service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:59.131070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3388ff-e555-4034-9d5f-c36fc1c440bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:59.132773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3388ff-e555-4034-9d5f-c36fc1c440bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:59.158970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3388ff-e555-4034-9d5f-c36fc1c440bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:24:59.162225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3388ff-e555-4034-9d5f-c36fc1c440bd service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:24:59.185558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 872/1751] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:24:59.477327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:59.480632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:59.480632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:59.576067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] MFA Rules not processed for user `1a4d9b43b40842ffb3ae76dd6dfef305`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:59.577361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:59.668800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:24:59.771829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 880/1752] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:59.782712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57fc9-f9b6-42c3-be4d-5636abed68a9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:24:59.783380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57fc9-f9b6-42c3-be4d-5636abed68a9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:24:59.783824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b57fc9-f9b6-42c3-be4d-5636abed68a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:24:59.856155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-12b57fc9-f9b6-42c3-be4d-5636abed68a9 None None] MFA Rules not processed for user `1a4d9b43b40842ffb3ae76dd6dfef305`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:24:59.864212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-12b57fc9-f9b6-42c3-be4d-5636abed68a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:24:59.907255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 873/1753] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:24:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:24:59.920539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:24:59.925794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:00.186167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b9827-504d-4d9e-84a6-31aea81558a4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:00.203269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cff657-affe-4c4a-988d-1517e948901d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:00.204104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cff657-affe-4c4a-988d-1517e948901d service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:00.204395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cff657-affe-4c4a-988d-1517e948901d service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:00.204675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cff657-affe-4c4a-988d-1517e948901d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:00.228325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cff657-affe-4c4a-988d-1517e948901d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:00.233691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cff657-affe-4c4a-988d-1517e948901d service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:00.273832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 881/1754] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:24:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:00.385685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:00.386933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:00.387490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:00.442108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] MFA Rules not processed for user `e7d1d99f0b074def89c572d944f8469a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:00.444113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:00.473067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd52de8-38d0-45fd-880e-3e75f88c451c None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:00.473330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd52de8-38d0-45fd-880e-3e75f88c451c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:00.473987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd52de8-38d0-45fd-880e-3e75f88c451c None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:00.476239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 882/1755] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 18 06:25:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:25:00.482867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:00.489717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:00.489717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:00.527194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:00.530276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:00.562623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 883/1756] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:25:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:00.576092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:00.578133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:00.660054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 874/1757] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:00.682329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:00.684602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:00.724760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e69b7b-c323-4262-a464-b8a26d617e46 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:00.751361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8cdeb-1040-4d0c-a126-1c2b79b08e11 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:00.753993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:00.755104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:00.756863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:00.757385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:00.769704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:00.783377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:00.783377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:00.783377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:00.783377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:00.784177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:00.788188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:00.809574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:00.811317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:00.820056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 875/1758] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:00.852531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 884/1759] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:00.862895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:00.864002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:00.897138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdfab5e-177f-4488-8de7-0aa9f4dca26b service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:00.904750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:00.905945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:00.906715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:00.907168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] PATH_INFO: `/v3/projects/29480ece55764e969c59aa2bd3519897` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:00.908615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=29480ece55764e969c59aa2bd3519897)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:00.913205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:01.063895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29480ece55764e969c59aa2bd3519897', 'request_id': 'req-4b282bb9-1870-42d0-a206-a1d70d0995ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:01.116183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29480ece55764e969c59aa2bd3519897', 'request_id': 'req-4b282bb9-1870-42d0-a206-a1d70d0995ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:01.245325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29480ece55764e969c59aa2bd3519897', 'request_id': 'req-4b282bb9-1870-42d0-a206-a1d70d0995ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:01.270526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] The token cache is being invalidate because project 29480ece55764e969c59aa2bd3519897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:01.270834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:01.272068 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4b282bb9-1870-42d0-a206-a1d70d0995ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:01.276985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 876/1760] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:00 2022] DELETE /identity/v3/projects/29480ece55764e969c59aa2bd3519897 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:01.285904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:01.307100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e0a4-5a6f-4c77-b255-12bcf120f2bb service glance] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:01.573646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:01.576762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:01.576762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:01.576762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] PATH_INFO: `/v3/users/4c7317aac245407ea646e253acaf9a05` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:01.576762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c7317aac245407ea646e253acaf9a05)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:01.582232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:01.941644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c66b-d78b-45f1-b8ab-cc3e699719b0 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:01.942030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c66b-d78b-45f1-b8ab-cc3e699719b0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:01.942177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0c66b-d78b-45f1-b8ab-cc3e699719b0 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:01.949879 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 877/1761] 10.222.0.27 () {54 vars in 912 bytes} [Mon Jul 18 06:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:25:01.967519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:01.967870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:01.968163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:02.023449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c7317aac245407ea646e253acaf9a05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:02.052616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] MFA Rules not processed for user `aff4923457aa4be498f954c73f4d0018`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:02.074223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:02.119821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c7317aac245407ea646e253acaf9a05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:02.120747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c7317aac245407ea646e253acaf9a05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:02.164331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c7317aac245407ea646e253acaf9a05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:02.165488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c7317aac245407ea646e253acaf9a05'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:02.204003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 885/1762] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:01 2022] DELETE /identity/v3/users/4c7317aac245407ea646e253acaf9a05 => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:02.405713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 878/1763] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:25:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:02.427614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:02.523286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:02.526024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:02.652109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1ebef-297a-43ca-a681-f44c12bf694d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:02.660579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:02.662044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:02.662576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:02.663049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:02.673762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:02.679571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:02.696643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 886/1764] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:03.598648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:04.700281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:04.701819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:04.734141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e99cd-6b23-4c37-8649-8399f34015df None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:04.891173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:05.061557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:05.067594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:05.068230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:05.068837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] PATH_INFO: `/v3/projects/6744bd70d53d4baaaecddb0c392d8ac8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:05.071800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6744bd70d53d4baaaecddb0c392d8ac8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:05.077111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:05.311839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6744bd70d53d4baaaecddb0c392d8ac8', 'request_id': 'req-1354ad5f-c411-4783-b063-234d43e64a56'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:05.325564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:05.331928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6744bd70d53d4baaaecddb0c392d8ac8', 'request_id': 'req-1354ad5f-c411-4783-b063-234d43e64a56'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:05.447862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:05.449877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:05.452571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6744bd70d53d4baaaecddb0c392d8ac8', 'request_id': 'req-1354ad5f-c411-4783-b063-234d43e64a56'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:05.478201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] The token cache is being invalidate because project 6744bd70d53d4baaaecddb0c392d8ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:05.478503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:05.480717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1354ad5f-c411-4783-b063-234d43e64a56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:05.482912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 879/1765] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:04 2022] DELETE /identity/v3/projects/6744bd70d53d4baaaecddb0c392d8ac8 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:05.490968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cc8f-6ffd-4a10-ad0b-e971c5e80829 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:05.491265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cc8f-6ffd-4a10-ad0b-e971c5e80829 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:05.491818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862cc8f-6ffd-4a10-ad0b-e971c5e80829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:05.599208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec810f0-6b9e-4f39-928c-d38fdee4f67c service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:05.659618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b862cc8f-6ffd-4a10-ad0b-e971c5e80829 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:05.670731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b862cc8f-6ffd-4a10-ad0b-e971c5e80829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:05.797469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:05.798364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:05.798653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:05.798934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] PATH_INFO: `/v3/users/605726dc1df1459c8e2f56faf0d7714c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:05.801686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605726dc1df1459c8e2f56faf0d7714c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:05.808086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:05.877399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 880/1766] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:05.879602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da89b-90a5-455d-92b0-4bca5a776575 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:05.879833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da89b-90a5-455d-92b0-4bca5a776575 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:05.880112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1da89b-90a5-455d-92b0-4bca5a776575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:05.968767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:06.011365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8d1da89b-90a5-455d-92b0-4bca5a776575 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:06.013438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8d1da89b-90a5-455d-92b0-4bca5a776575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:06.094521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605726dc1df1459c8e2f56faf0d7714c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:06.187026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605726dc1df1459c8e2f56faf0d7714c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:06.187871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605726dc1df1459c8e2f56faf0d7714c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:06.229468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 881/1767] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:25:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:06.232589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:06.232892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:06.233205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:06.240158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605726dc1df1459c8e2f56faf0d7714c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:06.241358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b5f68ee8-3eea-4b5a-b3a8-41c836eb3d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605726dc1df1459c8e2f56faf0d7714c'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:06.279122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 887/1768] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:05 2022] DELETE /identity/v3/users/605726dc1df1459c8e2f56faf0d7714c => generated 0 bytes in 832 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:06.280832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3415b8-d534-4425-8764-4692e1847d66 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:06.281406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3415b8-d534-4425-8764-4692e1847d66 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:06.281914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3415b8-d534-4425-8764-4692e1847d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:06.318475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dc3415b8-d534-4425-8764-4692e1847d66 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:06.320274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc3415b8-d534-4425-8764-4692e1847d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:06.325467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] MFA Rules not processed for user `4b57f9679e65450b9d97b0ce893fd6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:06.326718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:06.516311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 888/1769] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:06.518400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686497a6-fce2-45ad-9e13-650f8b401b26 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:06.519002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686497a6-fce2-45ad-9e13-650f8b401b26 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:06.519497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686497a6-fce2-45ad-9e13-650f8b401b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:06.543680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-686497a6-fce2-45ad-9e13-650f8b401b26 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:06.545314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-686497a6-fce2-45ad-9e13-650f8b401b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:06.558784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 889/1770] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:06.558784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686497a6-fce2-45ad-9e13-650f8b401b26 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:06.578669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686497a6-fce2-45ad-9e13-650f8b401b26 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:06.587645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 882/1771] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:06.597429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:06.604732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:06.605437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:06.605961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:06.607203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:06.608325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:06.610782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:06.628320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:06.630701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:06.654288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 890/1772] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:06.657902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:06.678491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1334a-4dcb-4201-ac15-4d4c187690a6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:06.685989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:06.686990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:06.687415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:06.687896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:06.689396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:06.708247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:06.753467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd494db6-c9a3-44ef-a99c-91f93f4330ac None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:06.761922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:06.761922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:06.761922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:06.762417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:06.777458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:06.779444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:06.838772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 883/1773] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:06.840576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:06.844857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:06.879468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 891/1774] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:06 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:06.882780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:07.143935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094f4a1-d8b8-4615-85a5-fe9a73f53c0c service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:07.148093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7fcba-23dc-407a-91a7-a71af3c67b71 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:07.161980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:07.168594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:07.169162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:07.173744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:07.175594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:07.187996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:07.281668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 892/1775] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:06 2022] POST /identity/v3/users => generated 292 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:07.282858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:07.287590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:07.288559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:07.288671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:07.288888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:07.290509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:07.329874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e783207-0c8b-4b81-8ece-df11f27016e9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:07.345173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:07.346247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:07.346737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:07.347131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] PATH_INFO: `/v3/users/e8c3cc1f04e64628adbda938898ddf78` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:07.352043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8c3cc1f04e64628adbda938898ddf78)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:07.355272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:07.445054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:07.446670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:07.465588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 884/1776] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:25:07.468415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:07.494329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c37577-3c87-49ce-969e-4a13e9780281 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:07.516794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:07.519181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:07.522505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:07.523171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:07.527524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:07.530767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:07.549077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 885/1777] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:07.551143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:07.575670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bb91a2-341c-44c4-ae6e-39fe12c13c44 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:07.598296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:07.599271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:07.599912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:07.600363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:07.604491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:07.607265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:07.715609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 886/1778] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:25:07.715609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:07.736366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a965af-a8a0-49f7-878a-b8543f7633a2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:07.797027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b250a0-4a1e-4d94-840e-ee889b5d3aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:07.797027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b250a0-4a1e-4d94-840e-ee889b5d3aad admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:07.797027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b250a0-4a1e-4d94-840e-ee889b5d3aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:07.797027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b250a0-4a1e-4d94-840e-ee889b5d3aad admin admin] PATH_INFO: `/v3/projects/9afc33252d434710ad5af3272e8c0530/users/e14546888dea494abee576b9d8cd005e/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:07.797341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b250a0-4a1e-4d94-840e-ee889b5d3aad admin admin] RBAC: Authorizing `identity:create_grant(project_id=9afc33252d434710ad5af3272e8c0530, user_id=e14546888dea494abee576b9d8cd005e, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:07.798266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b250a0-4a1e-4d94-840e-ee889b5d3aad admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:07.867027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8c3cc1f04e64628adbda938898ddf78'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:08.092304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8c3cc1f04e64628adbda938898ddf78'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:08.093423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8c3cc1f04e64628adbda938898ddf78'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:08.108409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 887/1779] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:07 2022] PUT /identity/v3/projects/9afc33252d434710ad5af3272e8c0530/users/e14546888dea494abee576b9d8cd005e/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:08.125478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476c83d-1c20-4f4d-839d-79e4bdac476d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:08.125478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476c83d-1c20-4f4d-839d-79e4bdac476d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:08.125478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476c83d-1c20-4f4d-839d-79e4bdac476d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:08.147694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8c3cc1f04e64628adbda938898ddf78'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:08.156584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b8a7dec3-e6e1-4fdb-818a-b7e995e8a157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8c3cc1f04e64628adbda938898ddf78'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:08.218270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3476c83d-1c20-4f4d-839d-79e4bdac476d None None] MFA Rules not processed for user `e14546888dea494abee576b9d8cd005e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:08.220310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3476c83d-1c20-4f4d-839d-79e4bdac476d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:08.243051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 893/1780] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:07 2022] DELETE /identity/v3/users/e8c3cc1f04e64628adbda938898ddf78 => generated 0 bytes in 959 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:08.247639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:08.247921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:08.249195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:08.314706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:08.317117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:08.414178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 888/1781] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:08.417993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:08.418424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:08.418713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:08.499193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] MFA Rules not processed for user `aff4923457aa4be498f954c73f4d0018`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:08.506187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:08.561520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 894/1782] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:08.566472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:08.573641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:08.612352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1cb21e-2668-40cf-98d9-0ce0e36c4c81 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:08.629679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:08.630888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:08.631392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:08.631898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:08.632875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:08.636290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:08.726419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 889/1783] 10.222.0.30 () {58 vars in 1015 bytes} [Mon Jul 18 06:25:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:08.730553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:08.735341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:08.761547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d625be-dcd8-4dd6-a6f8-afc26f38fc17 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:08.770476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:08.771163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:08.771843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:08.772154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:08.782212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 895/1784] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:08 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:08.785557 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:08.796319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:08.806209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:08.807750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:08.845889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 890/1785] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:08.847417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:08.871212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f53d-819c-4aa1-9992-f24708090510 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:08.912562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae5e04-a881-4938-a68c-cc07d03b58dc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:08.917210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:08.917878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:08.918161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:08.918435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:08.936377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:08.936475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:08.938504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:08.960829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 896/1786] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:09.009239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:09.009920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:09.010209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:09.010679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:09.011578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:09.028892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:09.198341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 891/1787] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:08 2022] POST /identity/v3/users => generated 298 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:09.199541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:09.254449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f3ea7-27ba-4a32-a632-5bd6fc78478a service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:09.271129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:09.271869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:09.272470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:09.272767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:09.274772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:09.290993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:09.352895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 897/1788] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:25:09.360887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:09.378090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd5bc67-afc9-4b48-a9fd-9a438baf9ac3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:09.389427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:09.392723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:09.394650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:09.396304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] PATH_INFO: `/v3/projects/fda195a1198b4ab09d6080307a37fc91/users/459e4a9dc1474d0da76fc7d63eb49971/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:09.484115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda195a1198b4ab09d6080307a37fc91, user_id=459e4a9dc1474d0da76fc7d63eb49971, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:09.508847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:09.665873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 892/1789] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:09 2022] PUT /identity/v3/projects/fda195a1198b4ab09d6080307a37fc91/users/459e4a9dc1474d0da76fc7d63eb49971/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:09.668002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:09.704738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beedfd90-bfee-48d3-a254-a3a6188a7b7b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:09.919496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:09.930075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:09.933416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:09.935362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:09.936968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:09.944556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:09.987803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 898/1790] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:09.992088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:10.005255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1a76a-6896-4a0f-8327-5cffadbcfe39 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:10.026681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5890e7f-7820-48b9-91b0-c86c839be587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:10.027815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890e7f-7820-48b9-91b0-c86c839be587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:10.030312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890e7f-7820-48b9-91b0-c86c839be587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:10.030826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5890e7f-7820-48b9-91b0-c86c839be587 admin admin] PATH_INFO: `/v3/projects/fda195a1198b4ab09d6080307a37fc91/users/459e4a9dc1474d0da76fc7d63eb49971/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:10.038246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5890e7f-7820-48b9-91b0-c86c839be587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda195a1198b4ab09d6080307a37fc91, user_id=459e4a9dc1474d0da76fc7d63eb49971, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:10.042241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:10.044413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:10.045427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5890e7f-7820-48b9-91b0-c86c839be587 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:10.061460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afa2740-4eaf-4fca-a543-459331d0ca66 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:10.080138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 893/1791] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:09 2022] PUT /identity/v3/projects/fda195a1198b4ab09d6080307a37fc91/users/459e4a9dc1474d0da76fc7d63eb49971/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:10.091435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:10.092734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:10.093247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:10.141310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] MFA Rules not processed for user `459e4a9dc1474d0da76fc7d63eb49971`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:10.142728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:10.181807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:10.182821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:10.183759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:10.196164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] PATH_INFO: `/v3/projects/7298bf58b8b6472b9e68c7605b87c9da` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:10.199097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7298bf58b8b6472b9e68c7605b87c9da)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:10.204839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:10.338660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 894/1792] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:10.353243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:10.355788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:10.475332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7298bf58b8b6472b9e68c7605b87c9da', 'request_id': 'req-6f16c183-b580-4545-a4c5-3c52c147a410'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:10.491564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7298bf58b8b6472b9e68c7605b87c9da', 'request_id': 'req-6f16c183-b580-4545-a4c5-3c52c147a410'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:10.583912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7298bf58b8b6472b9e68c7605b87c9da', 'request_id': 'req-6f16c183-b580-4545-a4c5-3c52c147a410'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:10.613646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] The token cache is being invalidate because project 7298bf58b8b6472b9e68c7605b87c9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:10.613646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:10.613646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6f16c183-b580-4545-a4c5-3c52c147a410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:10.624797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 899/1793] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:10 2022] DELETE /identity/v3/projects/7298bf58b8b6472b9e68c7605b87c9da => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:10.626774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84259bd-010c-4330-86af-cb8dd8401ad4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:10.627073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84259bd-010c-4330-86af-cb8dd8401ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:10.628032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84259bd-010c-4330-86af-cb8dd8401ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:10.639185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b7d28-ea02-4682-adbe-67749a2dd0cb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:10.639185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:10.713068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:10.731732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d84259bd-010c-4330-86af-cb8dd8401ad4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:10.733472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d84259bd-010c-4330-86af-cb8dd8401ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:10.906163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:10.935307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:10.936161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:10.936533 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:10.936919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:10.939000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:10.961828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 900/1794] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:10.970386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc90a0-98d6-4e56-8e6f-aed3a1134eab None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:10.970671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc90a0-98d6-4e56-8e6f-aed3a1134eab None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:10.972613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc90a0-98d6-4e56-8e6f-aed3a1134eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:11.037895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-abcc90a0-98d6-4e56-8e6f-aed3a1134eab None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:11.039284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-abcc90a0-98d6-4e56-8e6f-aed3a1134eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:11.070051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 901/1795] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:11.098575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc90a0-98d6-4e56-8e6f-aed3a1134eab None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:11.110329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:11.114894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:11.115129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc90a0-98d6-4e56-8e6f-aed3a1134eab None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:11.124146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:11.125352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:11.125709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:11.125974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:11.126935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:11.127117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:11.129332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:11.142215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 895/1796] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 789 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:11.164210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 902/1797] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:11.169425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:11.193731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc75307-22d6-4dda-9c6c-2758d0e6c5fe service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:11.210067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:11.210844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:11.211516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:11.211795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:11.212616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:11.215217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:11.250896 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:11.317448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 896/1798] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:11 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:11.321600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:11.357814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:11.387933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febd5a3-7472-4a64-b9ea-9a08e414fa90 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:11.451140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:11.455214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:11.656834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:11.665379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:11.666183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:11.670182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:11.672961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:11.681635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:11.787116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fc941-ca7b-4b98-8ec5-cd53d2fe51b4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:11.802977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ad947-5acd-475f-9807-fde8197ee5e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:11.804054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad947-5acd-475f-9807-fde8197ee5e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:11.804054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad947-5acd-475f-9807-fde8197ee5e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:11.804411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ad947-5acd-475f-9807-fde8197ee5e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:11.810049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-854ad947-5acd-475f-9807-fde8197ee5e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:11.842500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 903/1799] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:11 2022] POST /identity/v3/users => generated 293 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:11.849365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:11.888029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cfce5-14b5-4832-876c-e7d35e4275be admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:11.914460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:11.915632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:11.915970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:11.916290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:11.920844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:11.925127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:11.977571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 904/1800] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:11.981063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:12.004872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d0244-8db1-4a6b-a883-4738ade27ddc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:12.012570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:12.013540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:12.014327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:12.014614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:12.015600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:12.018222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:12.018922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:12.041647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 905/1801] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:12.044658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:12.059006 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d4373-7f1e-4f3f-9dd8-4e44f3ade3db admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:12.067550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:12.069528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:12.070754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ad947-5acd-475f-9807-fde8197ee5e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:12.073647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:12.074134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] PATH_INFO: `/v3/projects/c432f3d1ca814cd5bf74642166ca1406/users/c16e0f4328e046178456faf71d826392/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:12.074558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ad947-5acd-475f-9807-fde8197ee5e6 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:12.103027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c432f3d1ca814cd5bf74642166ca1406, user_id=c16e0f4328e046178456faf71d826392, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:12.107098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:12.123683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 897/1802] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:12.272285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c03c6-786b-4972-a703-1da71f3ab7b4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:12.272593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c03c6-786b-4972-a703-1da71f3ab7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:12.272864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c03c6-786b-4972-a703-1da71f3ab7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:12.274996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 906/1803] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:12 2022] PUT /identity/v3/projects/c432f3d1ca814cd5bf74642166ca1406/users/c16e0f4328e046178456faf71d826392/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:12.366108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9d0c03c6-786b-4972-a703-1da71f3ab7b4 None None] MFA Rules not processed for user `c16e0f4328e046178456faf71d826392`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:12.373066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9d0c03c6-786b-4972-a703-1da71f3ab7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:12.472758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:12.475422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:12.482190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:12.665644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9a5ef-42cb-4d39-b078-b530aa58eb34 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:12.739744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:12.742882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 898/1804] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:12.749583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c03c6-786b-4972-a703-1da71f3ab7b4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:12.749679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:12.749679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:12.749853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] PATH_INFO: `/v3/projects/2b08df94a2fd4f06a34457851e91dabe` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:12.754344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b08df94a2fd4f06a34457851e91dabe)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:12.762836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:12.810956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c03c6-786b-4972-a703-1da71f3ab7b4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:12.825957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:12.827313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:12.827782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:12.828171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:12.829210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:12.856284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:12.996322 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b08df94a2fd4f06a34457851e91dabe', 'request_id': 'req-9649b959-8049-443e-a6d9-9b217e2045fd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:13.009851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b08df94a2fd4f06a34457851e91dabe', 'request_id': 'req-9649b959-8049-443e-a6d9-9b217e2045fd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:13.073403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 899/1805] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:12 2022] POST /identity/v3/projects => generated 383 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:13.078223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:13.121941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b08df94a2fd4f06a34457851e91dabe', 'request_id': 'req-9649b959-8049-443e-a6d9-9b217e2045fd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:13.153552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] The token cache is being invalidate because project 2b08df94a2fd4f06a34457851e91dabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:13.161174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:13.161174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:13.161174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 907/1806] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:12 2022] DELETE /identity/v3/projects/2b08df94a2fd4f06a34457851e91dabe => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:13.174177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:13.191423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:13.262419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd31ef55-545f-4632-ba39-fca532ea8bd5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:13.284840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:13.288755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:13.289092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:13.289299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:13.320215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:13.323760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:13.494319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649b959-8049-443e-a6d9-9b217e2045fd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:13.507576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 900/1807] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:13 2022] POST /identity/v3/users => generated 292 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:13.516700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:13.516906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:13.517829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:13.518158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:13.522698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] PATH_INFO: `/v3/users/8e56161db1a24ac9844d5aafd0ae0899` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:13.528386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:13.530332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e56161db1a24ac9844d5aafd0ae0899)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:13.538395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:13.600662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a067c89f-7d1a-4918-ad49-940467d7ed00 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:13.615546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:13.617845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:13.618746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:13.618746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:13.619332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:13.624957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:13.686301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 901/1808] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:13.694186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:13.716952 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04213c31-42f2-40d9-9661-cd448b680645 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:13.736097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca81770-01f1-4681-8f79-5c08e1b12fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:13.737759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81770-01f1-4681-8f79-5c08e1b12fab admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:13.739654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81770-01f1-4681-8f79-5c08e1b12fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:13.739654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81770-01f1-4681-8f79-5c08e1b12fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:13.742753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca81770-01f1-4681-8f79-5c08e1b12fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:13.745636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca81770-01f1-4681-8f79-5c08e1b12fab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:13.807646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 902/1809] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:13.810176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17a268-c437-45ea-9e8e-b62fe9dc3f87 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:13.812642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17a268-c437-45ea-9e8e-b62fe9dc3f87 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:13.813305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17a268-c437-45ea-9e8e-b62fe9dc3f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:13.843827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:13.854907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fd17a268-c437-45ea-9e8e-b62fe9dc3f87 None None] MFA Rules not processed for user `e7d1d99f0b074def89c572d944f8469a`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:13.856957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fd17a268-c437-45ea-9e8e-b62fe9dc3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:13.875820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:13.894170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e56161db1a24ac9844d5aafd0ae0899'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:13.980014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 903/1810] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:13.982741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17a268-c437-45ea-9e8e-b62fe9dc3f87 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:14.013789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17a268-c437-45ea-9e8e-b62fe9dc3f87 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:14.014740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e56161db1a24ac9844d5aafd0ae0899'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:14.015870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e56161db1a24ac9844d5aafd0ae0899'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:14.030401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:14.031505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:14.032009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:14.033012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] PATH_INFO: `/v3/projects/f0754d86d1954626b58d039d4ff3cc6d/users/437ac2f7a53b4d378c3aecbac6a74e95/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:14.078140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e56161db1a24ac9844d5aafd0ae0899'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:14.078978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f5f57a66-3b84-4217-a177-2259016e1809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e56161db1a24ac9844d5aafd0ae0899'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:14.079874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0754d86d1954626b58d039d4ff3cc6d, user_id=437ac2f7a53b4d378c3aecbac6a74e95, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:14.084832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:14.121753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 908/1811] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:13 2022] DELETE /identity/v3/users/8e56161db1a24ac9844d5aafd0ae0899 => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:14.173429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 904/1812] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:13 2022] PUT /identity/v3/projects/f0754d86d1954626b58d039d4ff3cc6d/users/437ac2f7a53b4d378c3aecbac6a74e95/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:14.188867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c8531-0c91-4c2d-9531-ea88bc2d871b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:14.189414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c8531-0c91-4c2d-9531-ea88bc2d871b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:14.189876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c8531-0c91-4c2d-9531-ea88bc2d871b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:14.255369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-676c8531-0c91-4c2d-9531-ea88bc2d871b None None] MFA Rules not processed for user `437ac2f7a53b4d378c3aecbac6a74e95`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:14.256623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-676c8531-0c91-4c2d-9531-ea88bc2d871b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:14.474567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 909/1813] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:14.479432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:14.481535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:14.682886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc2970-ea3d-472f-aa75-990ecb496baa admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:14.700013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:14.701616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:14.702123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:14.702473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:14.703356 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:14.705511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:14.750842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eace9-59ee-469a-befd-407f2177e922 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:14.751454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eace9-59ee-469a-befd-407f2177e922 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:14.754896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eace9-59ee-469a-befd-407f2177e922 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:14.756681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 910/1814] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:25:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:25:14.825591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 905/1815] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:14 2022] POST /identity/v3/projects => generated 385 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:14.834221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eace9-59ee-469a-befd-407f2177e922 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:15.032953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eace9-59ee-469a-befd-407f2177e922 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:15.045522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:15.046713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:15.047179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:15.047618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:15.048518 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:15.061715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:15.267258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:15.270376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 911/1816] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:14 2022] POST /identity/v3/users => generated 299 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:15.302871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0834e2-eaad-4b0a-bca7-1aede3adffa9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:15.334795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94372c6d-4882-4494-ac95-556b091ed360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:15.338408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372c6d-4882-4494-ac95-556b091ed360 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:15.339341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372c6d-4882-4494-ac95-556b091ed360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:15.341132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94372c6d-4882-4494-ac95-556b091ed360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:15.350259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94372c6d-4882-4494-ac95-556b091ed360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:15.358490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94372c6d-4882-4494-ac95-556b091ed360 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:15.411069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 906/1817] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:15.414446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:15.431272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e3bb8-7c9e-4993-96c6-31d4c2c8fd3d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:15.439723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b128-734a-46be-bf13-136ee0fce46d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:15.440235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b128-734a-46be-bf13-136ee0fce46d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:15.441213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440b128-734a-46be-bf13-136ee0fce46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:15.444698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:15.446881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:15.446881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:15.446881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] PATH_INFO: `/v3/projects/13d0c56d7b0446c085556fe185aecfbf/users/8a3e72ba00114c0b9e40db61341523c6/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:15.474926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d0c56d7b0446c085556fe185aecfbf, user_id=8a3e72ba00114c0b9e40db61341523c6, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:15.481000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:15.499729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6440b128-734a-46be-bf13-136ee0fce46d None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:15.501932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6440b128-734a-46be-bf13-136ee0fce46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:15.599273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 912/1818] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:15 2022] PUT /identity/v3/projects/13d0c56d7b0446c085556fe185aecfbf/users/8a3e72ba00114c0b9e40db61341523c6/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:15.604580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:15.645594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:15.876064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe822737-730a-4c38-b714-ca93a08c1008 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:15.895017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 907/1819] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:25:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:15.896331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e31f8-d97e-435a-bdd6-32f28f630b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:15.897766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e31f8-d97e-435a-bdd6-32f28f630b04 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:15.900571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e31f8-d97e-435a-bdd6-32f28f630b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:15.900899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e31f8-d97e-435a-bdd6-32f28f630b04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:15.905518 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e31f8-d97e-435a-bdd6-32f28f630b04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:15.914030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e31f8-d97e-435a-bdd6-32f28f630b04 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:15.953960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 913/1820] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:15.954183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440b128-734a-46be-bf13-136ee0fce46d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:15.957133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:15.978230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440b128-734a-46be-bf13-136ee0fce46d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:15.996952 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:15.998324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:15.998686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:15.999039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] PATH_INFO: `/v3/projects/13d0c56d7b0446c085556fe185aecfbf/users/8a3e72ba00114c0b9e40db61341523c6/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:16.001634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d0c56d7b0446c085556fe185aecfbf, user_id=8a3e72ba00114c0b9e40db61341523c6, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:16.006081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:16.045740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 908/1821] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:15 2022] PUT /identity/v3/projects/13d0c56d7b0446c085556fe185aecfbf/users/8a3e72ba00114c0b9e40db61341523c6/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:16.057714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:16.058013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:16.058301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:16.117485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] MFA Rules not processed for user `8a3e72ba00114c0b9e40db61341523c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:16.122522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:16.345073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 914/1822] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:16.368872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:16.389512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:16.564169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46ea8a-d784-4952-97c6-5ad1dc5ad0ed admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:16.578180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:16.579140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:16.579488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:16.579830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:16.583777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:16.750632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:16.758649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:16.793148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 909/1823] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:16.975626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:16.978701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:17.099109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:17.100787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:17.209865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b414a-ba88-4c5d-a6a9-eaa8ee7b8000 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:17.219453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:17.222397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:17.222397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:17.222397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] PATH_INFO: `/v3/users/e14546888dea494abee576b9d8cd005e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:17.225281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14546888dea494abee576b9d8cd005e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:17.235385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:17.302609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1edfa-d83d-40d4-8d2a-e40806286a63 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:17.322337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406010f-170e-440c-a937-35c6ae8fdee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:17.325795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406010f-170e-440c-a937-35c6ae8fdee1 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:17.325795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406010f-170e-440c-a937-35c6ae8fdee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:17.325795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406010f-170e-440c-a937-35c6ae8fdee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:17.367231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406010f-170e-440c-a937-35c6ae8fdee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:17.368969 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406010f-170e-440c-a937-35c6ae8fdee1 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:17.397914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 910/1824] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:17.670897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:17.690955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14546888dea494abee576b9d8cd005e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:17.752863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23e98-a0d5-432f-9aa6-c1b243612b2e None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:17.753452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23e98-a0d5-432f-9aa6-c1b243612b2e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:17.754752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b23e98-a0d5-432f-9aa6-c1b243612b2e None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:17.756831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 911/1825] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:25:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:25:17.797592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14546888dea494abee576b9d8cd005e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:17.800369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14546888dea494abee576b9d8cd005e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:17.857032 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913051f-fb88-4a4b-8fdd-1762df341251 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:17.857628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913051f-fb88-4a4b-8fdd-1762df341251 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:17.858111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913051f-fb88-4a4b-8fdd-1762df341251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:17.894486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14546888dea494abee576b9d8cd005e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:17.897954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14546888dea494abee576b9d8cd005e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:17.901503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c913051f-fb88-4a4b-8fdd-1762df341251 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:17.909932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c913051f-fb88-4a4b-8fdd-1762df341251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:17.966948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 912/1826] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:25:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:17.992064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 915/1827] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:16 2022] DELETE /identity/v3/users/e14546888dea494abee576b9d8cd005e => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:17.995262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:17.996328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:17.996922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:18.027670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:18.037196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:18.180842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 913/1828] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:18.216642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:18.220213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:18.248484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:18.260182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84eada2-5aab-448b-a531-1ec754501c78 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:18.263092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:18.273123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:18.274695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:18.275144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:18.275669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:18.276276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] PATH_INFO: `/v3/projects/538ca3d961d049959bd5a6cd7666bd4f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:18.278434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] RBAC: Authorizing `identity:delete_project(project_id=538ca3d961d049959bd5a6cd7666bd4f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:18.281347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:18.497724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c2a826-9fa9-4475-89da-3f310d2fc3b4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:18.508897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538ca3d961d049959bd5a6cd7666bd4f', 'request_id': 'req-e91493ca-ebd5-441f-aa25-757c4c36369a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:18.526860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538ca3d961d049959bd5a6cd7666bd4f', 'request_id': 'req-e91493ca-ebd5-441f-aa25-757c4c36369a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:18.616386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538ca3d961d049959bd5a6cd7666bd4f', 'request_id': 'req-e91493ca-ebd5-441f-aa25-757c4c36369a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:18.619348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5267143-eb7d-4921-8dc3-c819c81bd127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:18.620926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267143-eb7d-4921-8dc3-c819c81bd127 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:18.621691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267143-eb7d-4921-8dc3-c819c81bd127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:18.621962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5267143-eb7d-4921-8dc3-c819c81bd127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:18.636804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] The token cache is being invalidate because project 538ca3d961d049959bd5a6cd7666bd4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:18.637132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:18.644372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e91493ca-ebd5-441f-aa25-757c4c36369a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:18.650835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 916/1829] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:18 2022] DELETE /identity/v3/projects/538ca3d961d049959bd5a6cd7666bd4f => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:18.652441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89a9e-56d2-41d6-964a-8c009116d53d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:18.652746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89a9e-56d2-41d6-964a-8c009116d53d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:18.653074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b89a9e-56d2-41d6-964a-8c009116d53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:18.694226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c5b89a9e-56d2-41d6-964a-8c009116d53d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:18.695597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c5b89a9e-56d2-41d6-964a-8c009116d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:18.776916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5267143-eb7d-4921-8dc3-c819c81bd127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:18.780822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5267143-eb7d-4921-8dc3-c819c81bd127 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:18.820182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 914/1830] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:18.878083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 917/1831] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:18.893925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55f11-3e10-4881-9947-4e3bb721e917 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:18.893925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55f11-3e10-4881-9947-4e3bb721e917 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:18.893925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc55f11-3e10-4881-9947-4e3bb721e917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:18.934198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-abc55f11-3e10-4881-9947-4e3bb721e917 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:18.935411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-abc55f11-3e10-4881-9947-4e3bb721e917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:18.947423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 915/1832] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:18.951814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89a9e-56d2-41d6-964a-8c009116d53d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:18.963066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b89a9e-56d2-41d6-964a-8c009116d53d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:18.968673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:18.969107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:18.969345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:18.972139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:18.972139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:18.972139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:18.973581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:18.992660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 918/1833] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:18.995279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55f11-3e10-4881-9947-4e3bb721e917 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:19.020578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc55f11-3e10-4881-9947-4e3bb721e917 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:19.022828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:19.023834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:19.024369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:19.024653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:19.025411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:19.027504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:19.168601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:19.176656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 916/1834] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:18 2022] POST /identity/v3/projects => generated 365 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:19.182876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d2def3-6007-4ad4-b659-a6a68266a99c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:19.365562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:19.367917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:19.369790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:19.370700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:19.372930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:19.409634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:19.525993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:19.571962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 919/1835] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:19 2022] POST /identity/v3/users => generated 283 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:19.577421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:19.579299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:19.581641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:19.603721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cae182-a4f2-4ea4-a2f1-9a37a7f8318e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:19.613685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:19.615377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:19.615485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:19.615713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:19.617310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:19.620277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:19.644150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 920/1836] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:19.647561 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:19.650903 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:19.785893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f374a2-4b7f-4665-95c7-38171cc12ebc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:19.796952 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:19.797985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545a795-d703-42c7-a46e-b18bc5b8ad01 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:19.801866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:19.802361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:19.804222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ab959-3b5a-4f19-a7c9-71f73eb3cc3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:19.805112 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab959-3b5a-4f19-a7c9-71f73eb3cc3a service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:19.805550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab959-3b5a-4f19-a7c9-71f73eb3cc3a service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:19.806173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ab959-3b5a-4f19-a7c9-71f73eb3cc3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:19.808338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c19ab959-3b5a-4f19-a7c9-71f73eb3cc3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:19.808922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:19.812488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:19.829834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:19.832403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:19.851512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 917/1837] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:19.853385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:19.868692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081e5617-3975-435d-97dd-d26d5196b813 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:19.876791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:19.877654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:19.879037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:19.880086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:19.884700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:19.885231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:19.907840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 918/1838] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:19.910369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:19.934480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d9bb6-dd66-4cd6-861e-eb8e2b476770 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:19.964383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:19.967235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:19.967593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:19.967948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] PATH_INFO: `/v3/projects/e9a3491181c34b6082575406cb61bf91/users/37ff43c0bd7540ba893939522fbf7696/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:20.003962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab959-3b5a-4f19-a7c9-71f73eb3cc3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:20.006061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ab959-3b5a-4f19-a7c9-71f73eb3cc3a service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:20.017283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 921/1839] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:20.038123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a3491181c34b6082575406cb61bf91, user_id=37ff43c0bd7540ba893939522fbf7696, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:20.053820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:20.056923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:20.174977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 919/1840] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:19 2022] PUT /identity/v3/projects/e9a3491181c34b6082575406cb61bf91/users/37ff43c0bd7540ba893939522fbf7696/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:20.186649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82608-f658-42d3-b0c5-eb5c63e8538e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:20.186947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82608-f658-42d3-b0c5-eb5c63e8538e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:20.187405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb82608-f658-42d3-b0c5-eb5c63e8538e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:20.235444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6eb82608-f658-42d3-b0c5-eb5c63e8538e None None] MFA Rules not processed for user `37ff43c0bd7540ba893939522fbf7696`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:20.237461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6eb82608-f658-42d3-b0c5-eb5c63e8538e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:20.388511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:20.390720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 922/1841] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:20 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:20.575993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03ad85-ee28-4a0a-bc66-ba84913db599 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:20.591220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:20.596917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:20.599637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:20.604235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:20.605253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:20.612557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:20.796275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 920/1842] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:20 2022] POST /identity/v3/projects => generated 365 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:20.799925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82608-f658-42d3-b0c5-eb5c63e8538e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:20.867651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb82608-f658-42d3-b0c5-eb5c63e8538e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:21.100223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:21.110079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:21.110479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:21.110829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:21.112424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:21.115123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:21.217121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:21.217691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 923/1843] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:20 2022] POST /identity/v3/users => generated 289 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:21.234058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a95db-ca63-4dee-bf09-e4c0fb4e1cba admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:21.249343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:21.250129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:21.250439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:21.250740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:21.251550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:21.254028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:21.285132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 921/1844] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:21.289419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:21.309484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fa0a1-c94c-4660-95b1-c75f51c9e259 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:21.322360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:21.322360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:21.322360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:21.322360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] PATH_INFO: `/v3/projects/e981beb25a154e13a6ffe6497300f3ce/users/3bc66db190bf47a6a7776801c66c0683/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:21.351812 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e981beb25a154e13a6ffe6497300f3ce, user_id=3bc66db190bf47a6a7776801c66c0683, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:21.355570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:21.415587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:21.499319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 924/1845] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:21 2022] PUT /identity/v3/projects/e981beb25a154e13a6ffe6497300f3ce/users/3bc66db190bf47a6a7776801c66c0683/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:21.504285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:21.520010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be188d-5458-4ce5-bcc7-3e060efede39 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:21.577269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:21.687100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228884e-6c9e-45a1-8c38-fb81ab5f8cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:21.688779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228884e-6c9e-45a1-8c38-fb81ab5f8cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:21.689258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228884e-6c9e-45a1-8c38-fb81ab5f8cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:21.689833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228884e-6c9e-45a1-8c38-fb81ab5f8cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:21.690877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228884e-6c9e-45a1-8c38-fb81ab5f8cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:21.692798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228884e-6c9e-45a1-8c38-fb81ab5f8cc5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:21.719162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 922/1846] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:21.725860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:21.742284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae1069-3c5e-4f89-b75f-fdb9297aae78 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:21.771800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:21.781419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:21.781746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:21.783086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] PATH_INFO: `/v3/projects/e981beb25a154e13a6ffe6497300f3ce/users/3bc66db190bf47a6a7776801c66c0683/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:21.788045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e981beb25a154e13a6ffe6497300f3ce, user_id=3bc66db190bf47a6a7776801c66c0683, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:21.800597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:21.840735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 925/1847] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:21 2022] PUT /identity/v3/projects/e981beb25a154e13a6ffe6497300f3ce/users/3bc66db190bf47a6a7776801c66c0683/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:21.852066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:21.852358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:21.852644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:21.927786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] MFA Rules not processed for user `3bc66db190bf47a6a7776801c66c0683`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:21.929132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:22.089911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 923/1848] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:22.095238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:22.098306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:22.109433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:22.112226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:22.196273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94908-50b3-49c9-8ed7-97c39646e9d4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:22.202430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:22.203268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:22.219958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:22.219958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:22.232184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:22.235866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:22.255369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 924/1849] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:22 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:22.335203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c08329-5de2-4f0a-b7a6-0bc4641abf45 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:22.365834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:22.366747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:22.367738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:22.373307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] PATH_INFO: `/v3/projects/9afc33252d434710ad5af3272e8c0530` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:22.378123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9afc33252d434710ad5af3272e8c0530)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:22.380247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:22.396523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:22.425425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bdb88d-0876-40ef-b1ba-c3b7b078491d service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:22.438830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:22.442321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:22.442626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:22.442910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:22.451423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:22.598953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9afc33252d434710ad5af3272e8c0530', 'request_id': 'req-23757fd1-5e77-4ab2-bfa5-456df850aa7d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:22.615647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9afc33252d434710ad5af3272e8c0530', 'request_id': 'req-23757fd1-5e77-4ab2-bfa5-456df850aa7d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:22.619009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:22.620810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:22.635141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 925/1850] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:22.636168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:22.647202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d91ce-a857-4f2e-8811-13d4e4474532 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:22.710261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9afc33252d434710ad5af3272e8c0530', 'request_id': 'req-23757fd1-5e77-4ab2-bfa5-456df850aa7d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:22.760156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] The token cache is being invalidate because project 9afc33252d434710ad5af3272e8c0530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:22.760577 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:22.764008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:22.768896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 926/1851] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:22 2022] DELETE /identity/v3/projects/9afc33252d434710ad5af3272e8c0530 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:22.771615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:22.772872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:22.773322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:22.773471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:22.774330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:22.776819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:22.780590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:23.063688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23757fd1-5e77-4ab2-bfa5-456df850aa7d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:23.073066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:23.075040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:23.096661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:23.101156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:23.103248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:23.105704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] PATH_INFO: `/v3/users/459e4a9dc1474d0da76fc7d63eb49971` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:23.111304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 926/1852] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:23.114555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459e4a9dc1474d0da76fc7d63eb49971)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:23.122119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:23.274423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:23.444459 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:23.472790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459e4a9dc1474d0da76fc7d63eb49971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:23.616098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459e4a9dc1474d0da76fc7d63eb49971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:23.616795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459e4a9dc1474d0da76fc7d63eb49971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:23.641417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459e4a9dc1474d0da76fc7d63eb49971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:23.642523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-770bb19a-95cc-415d-bcdb-e92c9fa53d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459e4a9dc1474d0da76fc7d63eb49971'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:23.658683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 927/1853] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:22 2022] DELETE /identity/v3/users/459e4a9dc1474d0da76fc7d63eb49971 => generated 0 bytes in 886 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:24.219627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:24.267733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0668145d-952a-48ba-a212-25787a2506f4 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:24.438082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:24.440415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:24.441163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:24.442607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] PATH_INFO: `/v3/projects/fda195a1198b4ab09d6080307a37fc91` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:24.444614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda195a1198b4ab09d6080307a37fc91)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:24.449723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:24.613536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda195a1198b4ab09d6080307a37fc91', 'request_id': 'req-041dc948-2758-4f5f-b38f-ab85c562dfaa'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:24.629194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:24.631405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda195a1198b4ab09d6080307a37fc91', 'request_id': 'req-041dc948-2758-4f5f-b38f-ab85c562dfaa'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:24.701750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda195a1198b4ab09d6080307a37fc91', 'request_id': 'req-041dc948-2758-4f5f-b38f-ab85c562dfaa'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:24.714820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] The token cache is being invalidate because project fda195a1198b4ab09d6080307a37fc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:24.714968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:24.715638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-041dc948-2758-4f5f-b38f-ab85c562dfaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:24.717294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 927/1854] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:24 2022] DELETE /identity/v3/projects/fda195a1198b4ab09d6080307a37fc91 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:24.722254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15733b-cd2b-465b-8aa7-0998f871ed34 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:24.724262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15733b-cd2b-465b-8aa7-0998f871ed34 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:24.725340 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15733b-cd2b-465b-8aa7-0998f871ed34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:24.760054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5e15733b-cd2b-465b-8aa7-0998f871ed34 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:24.761335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5e15733b-cd2b-465b-8aa7-0998f871ed34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:24.846479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 928/1855] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:24.855376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62ce4-4667-49d5-997d-b63f5dff46bd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:24.855673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62ce4-4667-49d5-997d-b63f5dff46bd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:24.855989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e62ce4-4667-49d5-997d-b63f5dff46bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:24.876492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-13e62ce4-4667-49d5-997d-b63f5dff46bd None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:24.877852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-13e62ce4-4667-49d5-997d-b63f5dff46bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:24.886232 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 928/1856] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:24.890879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15733b-cd2b-465b-8aa7-0998f871ed34 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:24.902185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15733b-cd2b-465b-8aa7-0998f871ed34 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:24.907464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:24.908191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:24.909253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:24.909658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:24.910667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:24.910982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:24.912747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:24.928401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 929/1857] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:24.932765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62ce4-4667-49d5-997d-b63f5dff46bd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:24.943135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e62ce4-4667-49d5-997d-b63f5dff46bd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:24.947902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:24.948569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:24.948875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:24.949186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:24.949899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:24.951838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:25.055668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 929/1858] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:24 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:25.061532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:25.076494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737a86d-3e0c-4261-822b-b854591426c6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:25.155914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:25.155914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:25.155914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:25.155914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:25.156544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:25.156544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:25.233726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 930/1859] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:25 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:25.238634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:25.249768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43049843-0f0f-4b61-a561-c7caa778ccca admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:25.254457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:25.255121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:25.255415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:25.255686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:25.256411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:25.258044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:25.275277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 930/1860] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:25.277279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:25.288602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962d9a3-c53d-4c65-98b7-e723e1566589 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:25.293835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6996703-59c4-4d70-ac1b-555efcb0fac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:25.294512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996703-59c4-4d70-ac1b-555efcb0fac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:25.294795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996703-59c4-4d70-ac1b-555efcb0fac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:25.295067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6996703-59c4-4d70-ac1b-555efcb0fac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:25.295794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6996703-59c4-4d70-ac1b-555efcb0fac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:25.297428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6996703-59c4-4d70-ac1b-555efcb0fac2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:25.315593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 931/1861] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:25.318756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:25.329273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b87163-be01-4986-acb6-b3f38c9b9364 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:25.334592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:25.335738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:25.335883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:25.336168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] PATH_INFO: `/v3/projects/87ba250d2caa4c0eb010b27954d37772/users/6fdf56e36c78449c8eb728ff848ef941/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:25.352770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ba250d2caa4c0eb010b27954d37772, user_id=6fdf56e36c78449c8eb728ff848ef941, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:25.355579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:25.513337 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 931/1862] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:25 2022] PUT /identity/v3/projects/87ba250d2caa4c0eb010b27954d37772/users/6fdf56e36c78449c8eb728ff848ef941/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:25.519721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1cdc-6c13-4eba-9c65-26e96a7ed788 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:25.520106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1cdc-6c13-4eba-9c65-26e96a7ed788 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:25.520432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad1cdc-6c13-4eba-9c65-26e96a7ed788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:25.555260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-abad1cdc-6c13-4eba-9c65-26e96a7ed788 None None] MFA Rules not processed for user `6fdf56e36c78449c8eb728ff848ef941`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:25.558546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-abad1cdc-6c13-4eba-9c65-26e96a7ed788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:25.640258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 932/1863] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:25.645688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:25.739228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27707af-7920-4c56-a738-5960a4707063 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:25.745439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:25.746161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:25.746444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:25.746721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:25.747424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:25.749511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:25.887644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 932/1864] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:25 2022] POST /identity/v3/projects => generated 389 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:25.892011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad1cdc-6c13-4eba-9c65-26e96a7ed788 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:25.903890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad1cdc-6c13-4eba-9c65-26e96a7ed788 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:25.978790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:25.979500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:25.979783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:25.981977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:25.981977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:25.982767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:26.074126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 933/1865] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:25 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:26.078474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:26.090517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b66ae-f6e4-4686-bef7-abc3bbfbfb3c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:26.097941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:26.098682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:26.098920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:26.099247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:26.099989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:26.102029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:26.114907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 933/1866] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:26.119301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:26.137221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6c864-64fc-45dd-ae0e-620631e80db0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:26.144894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:26.145862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:26.146233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:26.146515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] PATH_INFO: `/v3/projects/01b97a04500345f5b10ed18dbbe21700/users/37867aa12fb94c88a538cffae36d5479/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:26.166282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b97a04500345f5b10ed18dbbe21700, user_id=37867aa12fb94c88a538cffae36d5479, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:26.169023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:26.252780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 934/1867] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:26 2022] PUT /identity/v3/projects/01b97a04500345f5b10ed18dbbe21700/users/37867aa12fb94c88a538cffae36d5479/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:26.256732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:26.267210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9586fe2-2a48-4702-85f0-4dfe132fa105 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:26.343190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465b44e-94fc-4333-8091-486117c75cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:26.343887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b44e-94fc-4333-8091-486117c75cad admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:26.344176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b44e-94fc-4333-8091-486117c75cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:26.344457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465b44e-94fc-4333-8091-486117c75cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:26.345307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465b44e-94fc-4333-8091-486117c75cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:26.347631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465b44e-94fc-4333-8091-486117c75cad admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:26.359993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 934/1868] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:26.365091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:26.376572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1cbfdd-0b1c-4bf9-a9ba-26789ea7b017 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:26.382714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:26.383645 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:26.384063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:26.384470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] PATH_INFO: `/v3/projects/01b97a04500345f5b10ed18dbbe21700/users/37867aa12fb94c88a538cffae36d5479/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:26.386816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b97a04500345f5b10ed18dbbe21700, user_id=37867aa12fb94c88a538cffae36d5479, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:26.395729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:26.409922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 935/1869] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:26 2022] PUT /identity/v3/projects/01b97a04500345f5b10ed18dbbe21700/users/37867aa12fb94c88a538cffae36d5479/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:26.422663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1443f-46f8-4c33-aa10-9c403adfd1c8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:26.424481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1443f-46f8-4c33-aa10-9c403adfd1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:26.424481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1443f-46f8-4c33-aa10-9c403adfd1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:26.466785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-64f1443f-46f8-4c33-aa10-9c403adfd1c8 None None] MFA Rules not processed for user `37867aa12fb94c88a538cffae36d5479`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:26.468142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-64f1443f-46f8-4c33-aa10-9c403adfd1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:26.542296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 935/1870] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:26.553994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:26.555678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:26.614410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbd979-d00e-4f4e-bfde-81640d0e11cc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:26.618155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:26.618813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:26.619098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:26.619376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:26.629705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:26.631141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:26.642195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 936/1871] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:26.730666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:26.803276 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1443f-46f8-4c33-aa10-9c403adfd1c8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:26.887948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:26.914408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1443f-46f8-4c33-aa10-9c403adfd1c8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:26.922325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:26.923660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:26.925564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:26.926563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] PATH_INFO: `/v3/users/6fdf56e36c78449c8eb728ff848ef941` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:26.928417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fdf56e36c78449c8eb728ff848ef941)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:26.930424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:27.233031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fdf56e36c78449c8eb728ff848ef941'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.250286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fdf56e36c78449c8eb728ff848ef941'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.258852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fdf56e36c78449c8eb728ff848ef941'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.338711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:27.340348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:27.342169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fdf56e36c78449c8eb728ff848ef941'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.342839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d2c3cb0a-69ed-4109-8d66-3921ea623c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fdf56e36c78449c8eb728ff848ef941'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.350259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 936/1872] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:26 2022] DELETE /identity/v3/users/6fdf56e36c78449c8eb728ff848ef941 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:27.363616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:27.363919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:27.365788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:27.371806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72d1b-81d3-469f-80c1-36fae5dae441 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:27.389188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:27.390885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:27.465468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:27.469612 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:27.473661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:27.475195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] PATH_INFO: `/v3/users/37ff43c0bd7540ba893939522fbf7696` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:27.477761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] RBAC: Authorizing `identity:delete_user(user_id=37ff43c0bd7540ba893939522fbf7696)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:27.480061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:27.536614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 937/1873] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:27.549784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:27.557127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:27.642147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052cc924-c597-4ba7-b03b-27834300e7b1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:27.647202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d90d1-5a5c-4502-98c1-26c614e2bf0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:27.648106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d90d1-5a5c-4502-98c1-26c614e2bf0d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:27.648487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d90d1-5a5c-4502-98c1-26c614e2bf0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:27.648869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d90d1-5a5c-4502-98c1-26c614e2bf0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:27.659984 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d90d1-5a5c-4502-98c1-26c614e2bf0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:27.661848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d90d1-5a5c-4502-98c1-26c614e2bf0d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:27.681111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 938/1874] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:27.868128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37ff43c0bd7540ba893939522fbf7696'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.944887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37ff43c0bd7540ba893939522fbf7696'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.945668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37ff43c0bd7540ba893939522fbf7696'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.969482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37ff43c0bd7540ba893939522fbf7696'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:27.971449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37ff43c0bd7540ba893939522fbf7696'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.006098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 937/1875] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:27 2022] DELETE /identity/v3/users/37ff43c0bd7540ba893939522fbf7696 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:28.010558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:28.010855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:28.014464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:28.055288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:28.057270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:28.088840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:28.091343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:28.223981 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 939/1876] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:28.240826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12b967-101f-4e28-a2b4-1326e610a88c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:28.246741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:28.248602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:28.248602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:28.248602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] PATH_INFO: `/v3/users/c16e0f4328e046178456faf71d826392` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:28.250158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16e0f4328e046178456faf71d826392)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:28.252925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:28.254819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:28.259366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:28.375643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fa452-f81e-4aca-979d-215e88f767eb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:28.389672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:28.392687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:28.392916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:28.393305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:28.406347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:28.409343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:28.422735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 940/1877] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:28.490639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:28.493254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:28.511678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3fe85-1f35-4b05-a23a-085de9cbadcc service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:28.516936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:28.518043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:28.518582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:28.519292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] PATH_INFO: `/v3/projects/87ba250d2caa4c0eb010b27954d37772` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:28.520954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ba250d2caa4c0eb010b27954d37772)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:28.523553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:28.578165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16e0f4328e046178456faf71d826392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.687329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ba250d2caa4c0eb010b27954d37772', 'request_id': 'req-f37e951c-1b82-4a03-938c-53701ce40691'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.692638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16e0f4328e046178456faf71d826392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.694119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16e0f4328e046178456faf71d826392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.713962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16e0f4328e046178456faf71d826392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.714496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ba250d2caa4c0eb010b27954d37772', 'request_id': 'req-f37e951c-1b82-4a03-938c-53701ce40691'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.714978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-ae6b94e9-4c8a-488f-b930-86eee8000399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16e0f4328e046178456faf71d826392'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.734997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 938/1878] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:28 2022] DELETE /identity/v3/users/c16e0f4328e046178456faf71d826392 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:28.738244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:28.738545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:28.738830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:28.761103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:28.762057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:28.805179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ba250d2caa4c0eb010b27954d37772', 'request_id': 'req-f37e951c-1b82-4a03-938c-53701ce40691'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.821346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] The token cache is being invalidate because project 87ba250d2caa4c0eb010b27954d37772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:28.821799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.822860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:28.825222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 941/1879] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:28 2022] DELETE /identity/v3/projects/87ba250d2caa4c0eb010b27954d37772 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:28.828721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:28.830951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:28.852674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 939/1880] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:28.868904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:28.871831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:28.954695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e951c-1b82-4a03-938c-53701ce40691 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:28.961645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:28.962884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:28.963346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:28.963630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] PATH_INFO: `/v3/users/37867aa12fb94c88a538cffae36d5479` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:28.965992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37867aa12fb94c88a538cffae36d5479)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:28.968795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:28.977057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90867f1a-a768-481f-808a-3f2b135c642b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:28.982069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:28.982877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:28.984270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:28.984792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:28.998195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:28.999857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:29.013723 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 940/1881] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:29.068554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:29.073935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:29.078085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:29.090871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628736c-418f-43ef-a107-595737d47ff8 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:29.098100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:29.098724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:29.099064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:29.099789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] PATH_INFO: `/v3/projects/e9a3491181c34b6082575406cb61bf91` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:29.101531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a3491181c34b6082575406cb61bf91)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:29.104281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:29.172027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37867aa12fb94c88a538cffae36d5479'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.183164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:29.201107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37867aa12fb94c88a538cffae36d5479'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.210461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37867aa12fb94c88a538cffae36d5479'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.257031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a3491181c34b6082575406cb61bf91', 'request_id': 'req-f132d629-b4b5-4416-aced-766ca48535f8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.264260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a3491181c34b6082575406cb61bf91', 'request_id': 'req-f132d629-b4b5-4416-aced-766ca48535f8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.331375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37867aa12fb94c88a538cffae36d5479'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.332412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37867aa12fb94c88a538cffae36d5479'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.351281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 942/1882] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:28 2022] DELETE /identity/v3/users/37867aa12fb94c88a538cffae36d5479 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:29.452174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a3491181c34b6082575406cb61bf91', 'request_id': 'req-f132d629-b4b5-4416-aced-766ca48535f8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.474220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] The token cache is being invalidate because project e9a3491181c34b6082575406cb61bf91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:29.478878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.489426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.498383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 941/1883] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:29 2022] DELETE /identity/v3/projects/e9a3491181c34b6082575406cb61bf91 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:29.503275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:29.505341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:29.614521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:29.616924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:29.669151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac807ce-8180-4504-af49-20fd531c6391 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:29.701502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:29.704994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:29.705529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:29.705937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] PATH_INFO: `/v3/users/3bc66db190bf47a6a7776801c66c0683` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:29.716519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc66db190bf47a6a7776801c66c0683)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:29.716519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:29.720360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132d629-b4b5-4416-aced-766ca48535f8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:29.742542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:29.743798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:29.744104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:29.744373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] PATH_INFO: `/v3/projects/c432f3d1ca814cd5bf74642166ca1406` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:29.746198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c432f3d1ca814cd5bf74642166ca1406)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:29.753338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:29.969591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c432f3d1ca814cd5bf74642166ca1406', 'request_id': 'req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.984821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc66db190bf47a6a7776801c66c0683'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:29.999533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c432f3d1ca814cd5bf74642166ca1406', 'request_id': 'req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.003969 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc66db190bf47a6a7776801c66c0683'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.028435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc66db190bf47a6a7776801c66c0683'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.140840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c432f3d1ca814cd5bf74642166ca1406', 'request_id': 'req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.154014 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] The token cache is being invalidate because project c432f3d1ca814cd5bf74642166ca1406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:30.154296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.154976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a7aa573-d81f-45cb-8aec-2c1b98c42df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.158413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 942/1884] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:29 2022] DELETE /identity/v3/projects/c432f3d1ca814cd5bf74642166ca1406 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:30.158413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570584e8-7628-43ab-b1df-ad7e38147638 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:30.158744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570584e8-7628-43ab-b1df-ad7e38147638 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:30.158887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570584e8-7628-43ab-b1df-ad7e38147638 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:30.160404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 943/1885] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:25:30.161069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570584e8-7628-43ab-b1df-ad7e38147638 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:30.162739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-570584e8-7628-43ab-b1df-ad7e38147638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:30.240876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc66db190bf47a6a7776801c66c0683'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.241633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-61951316-596c-4b7a-a7bc-7cdc961c08d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc66db190bf47a6a7776801c66c0683'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.250446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 943/1886] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:29 2022] DELETE /identity/v3/users/3bc66db190bf47a6a7776801c66c0683 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:30.251663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:30.252340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:30.252840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:30.257671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570584e8-7628-43ab-b1df-ad7e38147638 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:30.303772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:30.305436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:30.398795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:30.399957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:30.402414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:30.403125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] PATH_INFO: `/v3/users/437ac2f7a53b4d378c3aecbac6a74e95` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:30.405617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=437ac2f7a53b4d378c3aecbac6a74e95)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:30.411677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:30.455536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 944/1887] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:25:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:30.456721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:30.458322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:30.473704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680ffb5-e610-4ad3-8a2f-778814a5283f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:30.479287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:30.480439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:30.480899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:30.481538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] PATH_INFO: `/v3/projects/01b97a04500345f5b10ed18dbbe21700` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:30.482982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b97a04500345f5b10ed18dbbe21700)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:30.485725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:30.700245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437ac2f7a53b4d378c3aecbac6a74e95'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.700874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b97a04500345f5b10ed18dbbe21700', 'request_id': 'req-5f624dd2-283d-424f-b549-d81c07b6ec7a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.712225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b97a04500345f5b10ed18dbbe21700', 'request_id': 'req-5f624dd2-283d-424f-b549-d81c07b6ec7a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.783781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437ac2f7a53b4d378c3aecbac6a74e95'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.786771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437ac2f7a53b4d378c3aecbac6a74e95'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.803961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:30.804790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437ac2f7a53b4d378c3aecbac6a74e95'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.805675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437ac2f7a53b4d378c3aecbac6a74e95'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.820143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 944/1888] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:30 2022] DELETE /identity/v3/users/437ac2f7a53b4d378c3aecbac6a74e95 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:30.821884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:30.823339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:30.855625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b97a04500345f5b10ed18dbbe21700', 'request_id': 'req-5f624dd2-283d-424f-b549-d81c07b6ec7a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.872847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] The token cache is being invalidate because project 01b97a04500345f5b10ed18dbbe21700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:30.873598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.874746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5f624dd2-283d-424f-b549-d81c07b6ec7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:30.876630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 945/1889] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:30 2022] DELETE /identity/v3/projects/01b97a04500345f5b10ed18dbbe21700 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:30.883087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84345e-c093-4320-a4dc-336ebd3ed7f7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:30.883621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84345e-c093-4320-a4dc-336ebd3ed7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:30.884081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84345e-c093-4320-a4dc-336ebd3ed7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:30.909519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6a84345e-c093-4320-a4dc-336ebd3ed7f7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:30.911041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6a84345e-c093-4320-a4dc-336ebd3ed7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:30.938765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d1bb8-9aa5-4751-a307-3c2d10efe523 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:30.953545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:30.953545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:30.953545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:30.953545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:30.953886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:30.967749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:30.969558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:30.980936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 945/1890] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:30.981904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:30.983356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:30.995350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 946/1891] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:30.999285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:31.003705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2d9a-9ae1-4232-91dd-b386b82aacf0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.003705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2d9a-9ae1-4232-91dd-b386b82aacf0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.003957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a2d9a-9ae1-4232-91dd-b386b82aacf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.024918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a37a2d9a-9ae1-4232-91dd-b386b82aacf0 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:31.026598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a37a2d9a-9ae1-4232-91dd-b386b82aacf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:31.037770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 947/1892] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:31.042523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a2d9a-9ae1-4232-91dd-b386b82aacf0 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.063918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2785004-e861-48f2-a17d-885b04344974 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.067357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a2d9a-9ae1-4232-91dd-b386b82aacf0 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.072516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.073462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.073622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.073904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] PATH_INFO: `/v3/projects/e981beb25a154e13a6ffe6497300f3ce` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.075586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e981beb25a154e13a6ffe6497300f3ce)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.079530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.083095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.083588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.083873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.084156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.084972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:31.085374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.088230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.121176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 948/1893] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:31.123927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.137667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e76aa-3e04-4c13-9688-ef7559940265 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.152831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.154035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.156550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.157039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.159305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.161304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.258270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e981beb25a154e13a6ffe6497300f3ce', 'request_id': 'req-41116ed6-cc21-41b4-97ee-d9b893fe3170'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:31.275047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e981beb25a154e13a6ffe6497300f3ce', 'request_id': 'req-41116ed6-cc21-41b4-97ee-d9b893fe3170'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:31.313327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 949/1894] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:31 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:31.318179 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.387717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e981beb25a154e13a6ffe6497300f3ce', 'request_id': 'req-41116ed6-cc21-41b4-97ee-d9b893fe3170'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:31.413126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] The token cache is being invalidate because project e981beb25a154e13a6ffe6497300f3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:31.413126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:31.413992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-41116ed6-cc21-41b4-97ee-d9b893fe3170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:31.416271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 946/1895] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:30 2022] DELETE /identity/v3/projects/e981beb25a154e13a6ffe6497300f3ce => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:31.422930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cba2d-97ac-4d54-b65e-f134c5983a11 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.423220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cba2d-97ac-4d54-b65e-f134c5983a11 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.423505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cba2d-97ac-4d54-b65e-f134c5983a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.428300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c2a9b-7446-4222-8813-d325f9f29774 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.434376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.435093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.435365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.435657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.436425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.438531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.468462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5d9cba2d-97ac-4d54-b65e-f134c5983a11 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:31.469799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5d9cba2d-97ac-4d54-b65e-f134c5983a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:31.491323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 947/1896] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:31.499521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b30df-f309-44eb-b4a7-d2c6ea05951d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.500195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b30df-f309-44eb-b4a7-d2c6ea05951d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.500553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b30df-f309-44eb-b4a7-d2c6ea05951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.533719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-1c4b30df-f309-44eb-b4a7-d2c6ea05951d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:31.539810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1c4b30df-f309-44eb-b4a7-d2c6ea05951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:31.550852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 948/1897] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:31.552366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 950/1898] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:31 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:31.556310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b30df-f309-44eb-b4a7-d2c6ea05951d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.556915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.559664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:31.567310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b30df-f309-44eb-b4a7-d2c6ea05951d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.572565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.575275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.575275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.575275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.575596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:31.576087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.578131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.587673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2e917-735c-44ae-b1ee-8f7c9c0cc3fe admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.592745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 949/1899] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:31.597722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.598286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.598973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.599447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.600406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.601186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.602957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.612010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0a1b-d00e-4281-91b1-6b8ec4e8708c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.618126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.618806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.619094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.619375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.620076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.622047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.622815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 951/1900] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:31.626544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.643040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3329d93-60cf-42fd-af84-83bcb03f5e39 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.651829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.652910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.654245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.654678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.655560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.658511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.673294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 952/1901] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:25:31.677624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.691781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce6cf09-32dd-452f-84c8-fc7387930476 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.697387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.698046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.698463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.698747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] PATH_INFO: `/v3/projects/6811a05c7e4b4ec781f8e9ae28ba35b9/users/fa3c799e267c4c77b946a7d4d8ab1237/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.728452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6811a05c7e4b4ec781f8e9ae28ba35b9, user_id=fa3c799e267c4c77b946a7d4d8ab1237, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.731599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.735839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 950/1902] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:31 2022] POST /identity/v3/projects => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:31.737902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.740683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:31.828159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4837a0d7-a2d5-491b-b57e-7920ba502ef5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.838559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 953/1903] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:31 2022] PUT /identity/v3/projects/6811a05c7e4b4ec781f8e9ae28ba35b9/users/fa3c799e267c4c77b946a7d4d8ab1237/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:31.849326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:31.906813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.907974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.910078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.910516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] PATH_INFO: `/v3/projects/f0754d86d1954626b58d039d4ff3cc6d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.912517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0754d86d1954626b58d039d4ff3cc6d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.915897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:31.964721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67a947-61de-451e-ac0d-9770a36e633b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:31.969486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f84f09-abb4-416c-b32f-3a8e47177b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:31.970169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84f09-abb4-416c-b32f-3a8e47177b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:31.970463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84f09-abb4-416c-b32f-3a8e47177b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:31.971392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f84f09-abb4-416c-b32f-3a8e47177b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:31.972373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f84f09-abb4-416c-b32f-3a8e47177b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:31.974357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f84f09-abb4-416c-b32f-3a8e47177b0f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.046040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0754d86d1954626b58d039d4ff3cc6d', 'request_id': 'req-56650495-d372-4b50-b328-cd00ee793021'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.053910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0754d86d1954626b58d039d4ff3cc6d', 'request_id': 'req-56650495-d372-4b50-b328-cd00ee793021'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.068017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 954/1904] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:31 2022] POST /identity/v3/users => generated 284 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:32.069892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.070185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.070610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.103967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] MFA Rules not processed for user `fa3c799e267c4c77b946a7d4d8ab1237`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:32.105220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:32.141814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0754d86d1954626b58d039d4ff3cc6d', 'request_id': 'req-56650495-d372-4b50-b328-cd00ee793021'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.154911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] The token cache is being invalidate because project f0754d86d1954626b58d039d4ff3cc6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:32.155204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.155864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.157499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 951/1905] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:31 2022] DELETE /identity/v3/projects/f0754d86d1954626b58d039d4ff3cc6d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:32.158940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.162011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:32.177932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 955/1906] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:32.178881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.180328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:32.235413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56650495-d372-4b50-b328-cd00ee793021 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.240270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.240941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.241252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.241526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.242256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.243879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.250292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d1a7b-3318-4566-a7ab-2de93efcaa5d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.254711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 952/1907] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:32.255793 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.256683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.256971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.257300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] PATH_INFO: `/v3/users/8a3e72ba00114c0b9e40db61341523c6` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.258518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3e72ba00114c0b9e40db61341523c6)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.258625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.260256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:32.260634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.273870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a2e42-90f2-4e01-963e-998848f9b5d7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.278791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.279442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.279725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.279999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.280683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.282646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.384559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 953/1908] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:32 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:32.385435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.445271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533930f-ef2f-4b2d-b04d-6f6964020075 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.449945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.450603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.450886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.451161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.451879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.453508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.464774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 954/1909] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:32.465614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.477151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710316d-c8be-4aad-9007-ed396c6b43c8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.481884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.482577 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.482861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.483136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.483830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.485861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.506373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3e72ba00114c0b9e40db61341523c6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.519137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3e72ba00114c0b9e40db61341523c6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.526448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3e72ba00114c0b9e40db61341523c6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.628151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 955/1910] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:32 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:32.629083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.644385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a511018-681a-4ce7-a879-5068e6fee1ed admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.650039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b485611-b836-419a-b882-57b49212680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.650938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485611-b836-419a-b882-57b49212680e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.654125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485611-b836-419a-b882-57b49212680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.654125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b485611-b836-419a-b882-57b49212680e admin admin] PATH_INFO: `/v3/projects/8ddf0ce1d6e94620bd4493bc1762ed83/users/8a621c99a54e4b86b850085120b51a25/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.667774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b485611-b836-419a-b882-57b49212680e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddf0ce1d6e94620bd4493bc1762ed83, user_id=8a621c99a54e4b86b850085120b51a25, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.670515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b485611-b836-419a-b882-57b49212680e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.673263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3e72ba00114c0b9e40db61341523c6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.674957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3e72ba00114c0b9e40db61341523c6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:32.686380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 956/1911] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:32 2022] DELETE /identity/v3/users/8a3e72ba00114c0b9e40db61341523c6 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:32.686380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.686380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:32.767393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e12585-dd23-43c1-8c4e-6a2ee9dc468b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.773911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.774871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.775196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.775482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.776466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.778510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 956/1912] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:32 2022] PUT /identity/v3/projects/8ddf0ce1d6e94620bd4493bc1762ed83/users/8a621c99a54e4b86b850085120b51a25/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:32.779046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.792633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 957/1913] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:32.792830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.792830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.792830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.793674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.808385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441985fb-a448-4981-aa64-fb37f1bf20f7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.830590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] MFA Rules not processed for user `8a621c99a54e4b86b850085120b51a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:32.832410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:32.887735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.888650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.888950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.889248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] PATH_INFO: `/v3/projects/c4113ddf7a71417cae74f8f0c5f37be3/users/2595e20cd5824d2c87ca82c0c8a99fbe/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.907265 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4113ddf7a71417cae74f8f0c5f37be3, user_id=2595e20cd5824d2c87ca82c0c8a99fbe, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.909672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 957/1914] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:32.911357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:32.917791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:32.919287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:32.938767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11a168-7d32-445e-a741-26f1932c14a7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:32.945357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:32.946093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:32.946385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:32.946665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:32.947362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:32.949362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.001185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 958/1915] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:32 2022] PUT /identity/v3/projects/c4113ddf7a71417cae74f8f0c5f37be3/users/2595e20cd5824d2c87ca82c0c8a99fbe/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:33.005906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.070708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d7ecf-0789-4065-84d3-07ece8d13da2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:33.078585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:33.079278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.080458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.080820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.081751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:33.082696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 958/1916] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:32 2022] POST /identity/v3/projects => generated 369 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:33.083536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.086437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.096689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 959/1917] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:25:33.099212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.118423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628a2df-54a6-434a-ac6e-990128a3dc1c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:33.205272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f32d7-a426-44b8-b942-6fce1ac1afd2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:33.215087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658896d-a12b-4af9-9c25-05d4ee64c421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:33.216450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658896d-a12b-4af9-9c25-05d4ee64c421 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.217026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658896d-a12b-4af9-9c25-05d4ee64c421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.218455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658896d-a12b-4af9-9c25-05d4ee64c421 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.218635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658896d-a12b-4af9-9c25-05d4ee64c421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:33.222863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658896d-a12b-4af9-9c25-05d4ee64c421 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.230349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:33.232477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.233170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.234285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] PATH_INFO: `/v3/projects/c4113ddf7a71417cae74f8f0c5f37be3/users/2595e20cd5824d2c87ca82c0c8a99fbe/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.239942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4113ddf7a71417cae74f8f0c5f37be3, user_id=2595e20cd5824d2c87ca82c0c8a99fbe, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:33.251682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.265293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 960/1918] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:33 2022] PUT /identity/v3/projects/c4113ddf7a71417cae74f8f0c5f37be3/users/2595e20cd5824d2c87ca82c0c8a99fbe/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:33.270038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.277225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:33.378640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526666e-8ef6-4057-b2e1-f773dda6be40 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:33.383865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:33.384741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.385049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.385499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] PATH_INFO: `/v3/projects/13d0c56d7b0446c085556fe185aecfbf` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.386755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d0c56d7b0446c085556fe185aecfbf)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:33.388720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.418825 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 959/1919] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:33 2022] POST /identity/v3/users => generated 291 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:33.421295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc1366-690b-4f28-95cd-3461d62c0d35 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.421783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc1366-690b-4f28-95cd-3461d62c0d35 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.422025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc1366-690b-4f28-95cd-3461d62c0d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.453911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bccc1366-690b-4f28-95cd-3461d62c0d35 None None] MFA Rules not processed for user `2595e20cd5824d2c87ca82c0c8a99fbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:33.455690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bccc1366-690b-4f28-95cd-3461d62c0d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:33.532849 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d0c56d7b0446c085556fe185aecfbf', 'request_id': 'req-c4e4227a-4e19-4015-a024-9d8ba74557b4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:33.540040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d0c56d7b0446c085556fe185aecfbf', 'request_id': 'req-c4e4227a-4e19-4015-a024-9d8ba74557b4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:33.545152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 960/1920] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:33.546788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc1366-690b-4f28-95cd-3461d62c0d35 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.561832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc1366-690b-4f28-95cd-3461d62c0d35 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:33.644789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:33.645354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.645643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.646533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.647333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:33.649838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.662413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 961/1921] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:33.663250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.665159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:33.719671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d0c56d7b0446c085556fe185aecfbf', 'request_id': 'req-c4e4227a-4e19-4015-a024-9d8ba74557b4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:33.742259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] The token cache is being invalidate because project 13d0c56d7b0446c085556fe185aecfbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:33.743082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:33.744004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:33.746714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 961/1922] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:33 2022] DELETE /identity/v3/projects/13d0c56d7b0446c085556fe185aecfbf => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:33.748070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.751776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:33.763063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d425cdc-d80a-4d77-b214-e189f63c7e3f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:33.775186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:33.776134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.776430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.776713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.777387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4227a-4e19-4015-a024-9d8ba74557b4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:33.778920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:33.785688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bb77a-1c7f-41ba-a0f7-90c7d860f9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:33.787069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bb77a-1c7f-41ba-a0f7-90c7d860f9af admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.787532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bb77a-1c7f-41ba-a0f7-90c7d860f9af admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.788080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bb77a-1c7f-41ba-a0f7-90c7d860f9af admin admin] PATH_INFO: `/v3/projects/ba6f2bb5bf054f78bda7241cc5721e67/users/018fa98935f04e2a9cd975930b94be87/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.831648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bb77a-1c7f-41ba-a0f7-90c7d860f9af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6f2bb5bf054f78bda7241cc5721e67, user_id=018fa98935f04e2a9cd975930b94be87, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:33.840164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bb77a-1c7f-41ba-a0f7-90c7d860f9af admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.914664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:33.916178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:33.934409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 962/1924] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:33 2022] PUT /identity/v3/projects/ba6f2bb5bf054f78bda7241cc5721e67/users/018fa98935f04e2a9cd975930b94be87/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:33.935312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d374-f15c-4af5-9139-113cf05ef9aa None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:33.935608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d374-f15c-4af5-9139-113cf05ef9aa None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:33.937009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 962/1924] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:33.937128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843d374-f15c-4af5-9139-113cf05ef9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:33.937665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:33.959920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43521f69-cce1-4f74-bb67-2e7652166ad6 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.007460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d843d374-f15c-4af5-9139-113cf05ef9aa None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:34.008791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d843d374-f15c-4af5-9139-113cf05ef9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.046029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.047870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.048271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.048667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.050039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.054976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.081426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 963/1925] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:34.092460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:34.100762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f6b5f-c0b9-4197-a553-4b1a63804ddb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.108707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.110148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.111407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.111932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] PATH_INFO: `/v3/projects/ba6f2bb5bf054f78bda7241cc5721e67/users/018fa98935f04e2a9cd975930b94be87/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.115959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba6f2bb5bf054f78bda7241cc5721e67, user_id=018fa98935f04e2a9cd975930b94be87, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.119544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.164302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 964/1926] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:34 2022] PUT /identity/v3/projects/ba6f2bb5bf054f78bda7241cc5721e67/users/018fa98935f04e2a9cd975930b94be87/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:34.165252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:34.172292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.175467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 963/1927] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:34.179509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead499-1856-4dce-af2e-6aab2fc76527 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.180123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead499-1856-4dce-af2e-6aab2fc76527 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.180867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ead499-1856-4dce-af2e-6aab2fc76527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.233789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d1ead499-1856-4dce-af2e-6aab2fc76527 None None] MFA Rules not processed for user `018fa98935f04e2a9cd975930b94be87`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:34.235437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d1ead499-1856-4dce-af2e-6aab2fc76527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.324101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a670ff-3112-4194-938d-e5e97624ad9c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.336872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 964/1928] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:34 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:34.337130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.337130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.337130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.337130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] PATH_INFO: `/v3/users/4473d6258f574d3789abe9d068fc313f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.337410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4473d6258f574d3789abe9d068fc313f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.338679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.338777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.338984 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.339267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.365144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:34.366438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.375143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 965/1929] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:34.375990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:34.378165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.464649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2925a4-d191-4c5a-8349-0b26b0fcbad7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.468774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.469480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.469768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.470042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.485383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.486939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.506270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 966/1930] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:34.506270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:34.522000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cee4c-d4f4-49c4-81cd-ae74aea31772 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.537229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.541317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.541317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.541317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.541317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:34.541317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.542497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.559269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 967/1931] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:34.563603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:34.575965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e726a1-14d1-467c-aee3-7d65f65072d3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.581928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.582601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.582887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.583215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.583940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.586953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.608083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4473d6258f574d3789abe9d068fc313f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:34.696582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4473d6258f574d3789abe9d068fc313f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:34.697237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4473d6258f574d3789abe9d068fc313f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:34.704959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 968/1932] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:34 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:34.710080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:34.711984 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.723955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4473d6258f574d3789abe9d068fc313f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:34.724955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c764eeb-c97f-4ba4-a250-2deb99fad108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4473d6258f574d3789abe9d068fc313f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:34.738555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 965/1933] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:34 2022] DELETE /identity/v3/users/4473d6258f574d3789abe9d068fc313f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:34.743231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.743567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.743802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.764489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:34.764894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.789485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:34.798905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c1559-102e-4a45-be20-1e5ac976fcf2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.847543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:34.864380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 966/1934] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:34.870991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.871757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.872046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.872804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.873194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.874451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:34.875450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.876448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:34.953673 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636d2e1-c35e-424c-bfbf-738a910f2f09 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:34.959785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:34.960745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:34.961704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:34.961704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:34.973615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:34.975409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:34.985151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 969/1935] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:34 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:34.989017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 967/1936] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:34.990384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:35.001395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47e640-f068-48b3-a725-961fc52482ab admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:35.022135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:35.026349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:35.026349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:35.026349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:35.026349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:35.026349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:35.038896 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 970/1937] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:35.042562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:35.056604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45e7d1-5222-474c-af00-0c159e5e8f14 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:35.065173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357382c-e22d-48ec-9298-c7aba06a5e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:35.066111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357382c-e22d-48ec-9298-c7aba06a5e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:35.066543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357382c-e22d-48ec-9298-c7aba06a5e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:35.066827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357382c-e22d-48ec-9298-c7aba06a5e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:35.067568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357382c-e22d-48ec-9298-c7aba06a5e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:35.069235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357382c-e22d-48ec-9298-c7aba06a5e37 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:35.095343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 968/1938] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:35.095763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:35.106810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81074e36-5ecc-4613-b71f-fa0b9d9f6249 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:35.112174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:35.113242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:35.113627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:35.113989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] PATH_INFO: `/v3/projects/67c38853ef2447e18f5fd912efe5d72c/users/b3bd17da8b404147bf3f2183e921c970/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:35.131381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c38853ef2447e18f5fd912efe5d72c, user_id=b3bd17da8b404147bf3f2183e921c970, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:35.134146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:35.231560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 971/1939] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:35 2022] PUT /identity/v3/projects/67c38853ef2447e18f5fd912efe5d72c/users/b3bd17da8b404147bf3f2183e921c970/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:35.243087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:35.243372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:35.243648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:35.279736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] MFA Rules not processed for user `b3bd17da8b404147bf3f2183e921c970`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:35.281606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:35.394419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 969/1940] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:35.596385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:35.598319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:35.630826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:35.634189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:35.732673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199d6d-0e81-4561-a21a-cee94a107e96 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:35.742638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:35.743313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:35.743935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:35.744222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:35.767465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:35.771524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:35.772942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dbd8c-a82c-420d-9e1a-7483e3548596 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:35.790382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:35.791413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:35.791729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:35.792021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] PATH_INFO: `/v3/projects/3d657637191a4cec927bd7af8d97964c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:35.793193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 972/1941] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:35.793529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d657637191a4cec927bd7af8d97964c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:35.797646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:35.797741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:35.797816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:35.812368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aff8b3-910b-48d0-891e-cf4701f53439 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:35.823635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:35.824751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:35.825397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:35.825904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] PATH_INFO: `/v3/users/fa3c799e267c4c77b946a7d4d8ab1237` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:35.827706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3c799e267c4c77b946a7d4d8ab1237)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:35.830517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:35.972493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d657637191a4cec927bd7af8d97964c', 'request_id': 'req-09b122a6-6ecd-44b4-998f-58f75bb96e88'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:35.977820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d657637191a4cec927bd7af8d97964c', 'request_id': 'req-09b122a6-6ecd-44b4-998f-58f75bb96e88'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.068938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d657637191a4cec927bd7af8d97964c', 'request_id': 'req-09b122a6-6ecd-44b4-998f-58f75bb96e88'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.092312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3c799e267c4c77b946a7d4d8ab1237'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.098640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] The token cache is being invalidate because project 3d657637191a4cec927bd7af8d97964c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:36.098943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.100174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.104198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 970/1942] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:35 2022] DELETE /identity/v3/projects/3d657637191a4cec927bd7af8d97964c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:36.110568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:36.114019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:36.128509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3c799e267c4c77b946a7d4d8ab1237'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.139976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3c799e267c4c77b946a7d4d8ab1237'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.213123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b122a6-6ecd-44b4-998f-58f75bb96e88 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:36.218040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:36.218621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:36.218908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:36.219187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] PATH_INFO: `/v3/users/d4a73b3963a7423a9f49533545c39cbc` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:36.220447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a73b3963a7423a9f49533545c39cbc)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:36.222978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:36.326044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3c799e267c4c77b946a7d4d8ab1237'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.328909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d7d42339-397c-4f66-bcc0-fd954ef65d30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3c799e267c4c77b946a7d4d8ab1237'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.340709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 973/1943] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:35 2022] DELETE /identity/v3/users/fa3c799e267c4c77b946a7d4d8ab1237 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:36.342178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:36.349815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:36.350195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:36.376038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:36.377439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:36.449838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 974/1944] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:36.460246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:36.466132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:36.565507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a73b3963a7423a9f49533545c39cbc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.595373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a91c68a-2cbb-4f2c-950a-02d61ce1b6da None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:36.599708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:36.600375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:36.600708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:36.601254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:36.612661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:36.614377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:36.635031 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 975/1945] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:36.654992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a73b3963a7423a9f49533545c39cbc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.656956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a73b3963a7423a9f49533545c39cbc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.685954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a73b3963a7423a9f49533545c39cbc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.690828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a73b3963a7423a9f49533545c39cbc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:36.729943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 971/1946] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:36 2022] DELETE /identity/v3/users/d4a73b3963a7423a9f49533545c39cbc => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:37.490523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:37.492463 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:37.493588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:37.509026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:37.514526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff10b072-2a08-40da-8ac1-0212a27b76e1 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:37.612764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:37.614108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:37.614641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:37.615113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] PATH_INFO: `/v3/projects/5688466ca8784920b58a606022199412` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:37.616573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5688466ca8784920b58a606022199412)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:37.618516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:37.670397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9e4fb-87fa-4827-a48f-94d0a3232d24 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:37.678223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:37.681301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:37.681301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:37.681301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] PATH_INFO: `/v3/projects/6811a05c7e4b4ec781f8e9ae28ba35b9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:37.681301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6811a05c7e4b4ec781f8e9ae28ba35b9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:37.683138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:37.754732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5688466ca8784920b58a606022199412', 'request_id': 'req-02881086-16f7-4c05-91e4-745be080ea5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.761044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5688466ca8784920b58a606022199412', 'request_id': 'req-02881086-16f7-4c05-91e4-745be080ea5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.844401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5688466ca8784920b58a606022199412', 'request_id': 'req-02881086-16f7-4c05-91e4-745be080ea5a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.853947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6811a05c7e4b4ec781f8e9ae28ba35b9', 'request_id': 'req-150a2e85-6af6-40dd-9bb8-2ce62e84044d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.857142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] The token cache is being invalidate because project 5688466ca8784920b58a606022199412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:37.857443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.858113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-02881086-16f7-4c05-91e4-745be080ea5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.859934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 976/1947] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:37 2022] DELETE /identity/v3/projects/5688466ca8784920b58a606022199412 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:37.860218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6811a05c7e4b4ec781f8e9ae28ba35b9', 'request_id': 'req-150a2e85-6af6-40dd-9bb8-2ce62e84044d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.864953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb229-cbac-41c8-ba33-27710bcfee3b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:37.865274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb229-cbac-41c8-ba33-27710bcfee3b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:37.866001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fb229-cbac-41c8-ba33-27710bcfee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:37.885255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-db5fb229-cbac-41c8-ba33-27710bcfee3b None None] MFA Rules not processed for user `b3bd17da8b404147bf3f2183e921c970`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:37.886788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-db5fb229-cbac-41c8-ba33-27710bcfee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:37.945321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 977/1948] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:37.946702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c988a-43c2-4648-a46a-93a50f2a8164 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:37.946994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c988a-43c2-4648-a46a-93a50f2a8164 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:37.947275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c988a-43c2-4648-a46a-93a50f2a8164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:37.966794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1d0c988a-43c2-4648-a46a-93a50f2a8164 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:37.968067 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1d0c988a-43c2-4648-a46a-93a50f2a8164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:37.975974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6811a05c7e4b4ec781f8e9ae28ba35b9', 'request_id': 'req-150a2e85-6af6-40dd-9bb8-2ce62e84044d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.993337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] The token cache is being invalidate because project 6811a05c7e4b4ec781f8e9ae28ba35b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:37.993967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.994806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:37.996555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 972/1949] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:37 2022] DELETE /identity/v3/projects/6811a05c7e4b4ec781f8e9ae28ba35b9 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:38.000662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.003369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:38.045625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 978/1950] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:38.054670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4591-51b7-41d9-b726-bdbc398ba5c8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.054910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4591-51b7-41d9-b726-bdbc398ba5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.055152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4591-51b7-41d9-b726-bdbc398ba5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.062456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:38.084035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-123f4591-51b7-41d9-b726-bdbc398ba5c8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:38.085304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-123f4591-51b7-41d9-b726-bdbc398ba5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:38.097218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 979/1951] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:38.099619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4591-51b7-41d9-b726-bdbc398ba5c8 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.099761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a2e85-6af6-40dd-9bb8-2ce62e84044d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.104526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.105836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.105949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.106209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] PATH_INFO: `/v3/users/2595e20cd5824d2c87ca82c0c8a99fbe` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.107466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2595e20cd5824d2c87ca82c0c8a99fbe)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.109600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4591-51b7-41d9-b726-bdbc398ba5c8 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.110376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.115792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.116473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.116761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.117076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.117918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:38.118233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.119891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.135600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 980/1952] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:38.140233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.150912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:38.159496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae54a7e-a145-4faf-8a76-aabdba26c5e0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.174280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.174280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.174280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.174280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.174644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.176818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.321495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 981/1953] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:38 2022] POST /identity/v3/projects => generated 357 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:38.325268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.361111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2595e20cd5824d2c87ca82c0c8a99fbe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:38.410914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17b2d6-c6c0-4065-9b01-a40563b3971b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.416097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.416784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.417102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.417380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.418125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.420660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.484424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2595e20cd5824d2c87ca82c0c8a99fbe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:38.485511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2595e20cd5824d2c87ca82c0c8a99fbe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:38.500879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2595e20cd5824d2c87ca82c0c8a99fbe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:38.502517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2595e20cd5824d2c87ca82c0c8a99fbe'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:38.516383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 973/1954] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:37 2022] DELETE /identity/v3/users/2595e20cd5824d2c87ca82c0c8a99fbe => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:38.545908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.547282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:38.564858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 982/1955] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:38 2022] POST /identity/v3/users => generated 279 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:38.569040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.574616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:38.601623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f5079-bb89-48be-800f-c286c01417fc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.699730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.700435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.700572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8969fd-54f6-4b99-80ac-4b692658ceb5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.700771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.701095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.702000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.704009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.713022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.714033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.714328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.714610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] PATH_INFO: `/v3/users/8a621c99a54e4b86b850085120b51a25` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.716109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a621c99a54e4b86b850085120b51a25)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.717700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 983/1956] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:38.721873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.722287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.744651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a553fa0-a1b4-4f2b-930f-c977c5be04ee admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.749793 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.750479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.750787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.751637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.752375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.755176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.766670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 984/1957] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:38.771026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:38.785263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d752d-15cf-4e13-863a-e8bd0a0b0929 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:38.789138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8685da4-87b3-4248-89cc-97e472342196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:38.790074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685da4-87b3-4248-89cc-97e472342196 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.790340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685da4-87b3-4248-89cc-97e472342196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.790619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8685da4-87b3-4248-89cc-97e472342196 admin admin] PATH_INFO: `/v3/projects/e846cee08c9f49bd9811856edbff6b17/users/e7f50310111f4426ab02c728022c1b00/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.810403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8685da4-87b3-4248-89cc-97e472342196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e846cee08c9f49bd9811856edbff6b17, user_id=e7f50310111f4426ab02c728022c1b00, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:38.814051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8685da4-87b3-4248-89cc-97e472342196 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:38.919667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 985/1958] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:38 2022] PUT /identity/v3/projects/e846cee08c9f49bd9811856edbff6b17/users/e7f50310111f4426ab02c728022c1b00/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:38.931544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b72641-686f-4d3c-bb44-27a64ee98873 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:38.931840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b72641-686f-4d3c-bb44-27a64ee98873 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:38.932115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b72641-686f-4d3c-bb44-27a64ee98873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:38.966237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b7b72641-686f-4d3c-bb44-27a64ee98873 None None] MFA Rules not processed for user `e7f50310111f4426ab02c728022c1b00`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:38.966724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a621c99a54e4b86b850085120b51a25'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:38.967653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b7b72641-686f-4d3c-bb44-27a64ee98873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:39.047602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 986/1959] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:38 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:39.053339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b72641-686f-4d3c-bb44-27a64ee98873 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.068252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a621c99a54e4b86b850085120b51a25'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.069184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a621c99a54e4b86b850085120b51a25'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.093948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a621c99a54e4b86b850085120b51a25'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.102885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d05bf9df-a8f8-4d82-8c6f-a89738766c45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a621c99a54e4b86b850085120b51a25'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.144280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 974/1960] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:38 2022] DELETE /identity/v3/users/8a621c99a54e4b86b850085120b51a25 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:39.150453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.150757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.151041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.151739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b72641-686f-4d3c-bb44-27a64ee98873 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:39.223204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:39.226691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:39.227205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:39.229039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.229439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.231347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.232396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:39.240529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 975/1961] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:39.240672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:39.259353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.261325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:39.359735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339185-0ff8-4f39-ad2b-17eb1cbc3f66 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:39.367413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:39.368092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.368381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.368664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.377319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 987/1962] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:39 2022] POST /identity/v3/projects => generated 355 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:39.382903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.387042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:39.394702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:39.396202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:39.412098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 976/1963] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:39.459317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.461940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:39.479427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d75b08-8819-4317-bede-5ffac95e057e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:39.485759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd0d9-f9c1-40c6-983e-24fcfe0d1fd0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:39.486816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:39.488232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.488756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.489074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] PATH_INFO: `/v3/projects/c4113ddf7a71417cae74f8f0c5f37be3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.490885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4113ddf7a71417cae74f8f0c5f37be3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:39.499048 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:39.500811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.501346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.502339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.503150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:39.503734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:39.505342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:39.600541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 988/1964] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:39 2022] POST /identity/v3/users => generated 284 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:39.610809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.637755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fe660-3b93-4378-8154-e151fe085be5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:39.650945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4113ddf7a71417cae74f8f0c5f37be3', 'request_id': 'req-d143ab41-7738-42d3-9943-126bc63d86e4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.657602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4113ddf7a71417cae74f8f0c5f37be3', 'request_id': 'req-d143ab41-7738-42d3-9943-126bc63d86e4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.736758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:39.737593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.737946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.738314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.739134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:39.741136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:39.753387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4113ddf7a71417cae74f8f0c5f37be3', 'request_id': 'req-d143ab41-7738-42d3-9943-126bc63d86e4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.764443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 989/1965] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:39.767034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.776091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] The token cache is being invalidate because project c4113ddf7a71417cae74f8f0c5f37be3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:39.776388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.777965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d143ab41-7738-42d3-9943-126bc63d86e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:39.790252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 977/1966] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:39 2022] DELETE /identity/v3/projects/c4113ddf7a71417cae74f8f0c5f37be3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:39.795266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1cfc0-970b-4e13-8239-d4bad9341b9f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.796803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1cfc0-970b-4e13-8239-d4bad9341b9f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.797121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea1cfc0-970b-4e13-8239-d4bad9341b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.805239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b93052-4775-438b-b858-0c7e431baf9e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:39.821734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:39.823586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.823586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.823586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] PATH_INFO: `/v3/projects/2ac994515cd641d8a86b2e4e4e2e7663/users/9b193aa788e64d04865f6def39e55175/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.850217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bea1cfc0-970b-4e13-8239-d4bad9341b9f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:39.851361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bea1cfc0-970b-4e13-8239-d4bad9341b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:39.862827 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac994515cd641d8a86b2e4e4e2e7663, user_id=9b193aa788e64d04865f6def39e55175, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:39.865555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:39.871041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 978/1967] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:39.880022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26bea-7a31-454f-b627-129443935ccb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:39.880308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26bea-7a31-454f-b627-129443935ccb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:39.880609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f26bea-7a31-454f-b627-129443935ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:39.916049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-15f26bea-7a31-454f-b627-129443935ccb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:39.917521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-15f26bea-7a31-454f-b627-129443935ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:39.933660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 979/1968] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:39.935002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26bea-7a31-454f-b627-129443935ccb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.953047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f26bea-7a31-454f-b627-129443935ccb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:39.956692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 990/1969] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:39 2022] PUT /identity/v3/projects/2ac994515cd641d8a86b2e4e4e2e7663/users/9b193aa788e64d04865f6def39e55175/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:39.961464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:39.965357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:40.050649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.053316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.053316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.053316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.053316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:40.053316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.055573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.070877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 980/1970] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:40.093247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd391c-5e94-4607-8fd3-3e66db6434b6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.094704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.099929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.100776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.101224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.101570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.102375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.104116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.118255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 991/1971] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:25:40.123504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.131033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29fa4a-b2bd-4350-a41e-cc1548719795 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.143435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadab156-3364-4121-bab6-bbda4c9774ea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.143613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.143613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.143613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.143613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.143889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.143889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.146476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fe6d1-67be-436c-ab43-5267324abd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.147391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fe6d1-67be-436c-ab43-5267324abd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.147715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fe6d1-67be-436c-ab43-5267324abd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.147954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fe6d1-67be-436c-ab43-5267324abd84 admin admin] PATH_INFO: `/v3/projects/2ac994515cd641d8a86b2e4e4e2e7663/users/9b193aa788e64d04865f6def39e55175/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.151515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fe6d1-67be-436c-ab43-5267324abd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac994515cd641d8a86b2e4e4e2e7663, user_id=9b193aa788e64d04865f6def39e55175, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.155760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fe6d1-67be-436c-ab43-5267324abd84 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.172022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 992/1972] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:40 2022] PUT /identity/v3/projects/2ac994515cd641d8a86b2e4e4e2e7663/users/9b193aa788e64d04865f6def39e55175/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:40.192118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3252-93c2-4d0d-b704-190e0c03bb7c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.192417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3252-93c2-4d0d-b704-190e0c03bb7c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.192696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b3252-93c2-4d0d-b704-190e0c03bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.230576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d44b3252-93c2-4d0d-b704-190e0c03bb7c None None] MFA Rules not processed for user `9b193aa788e64d04865f6def39e55175`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:40.235969 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d44b3252-93c2-4d0d-b704-190e0c03bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:40.245193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 981/1973] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:40 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:40.249566 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.251281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:40.354939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e8259-037c-4544-b5cd-063d3f5d2cfe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.363173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.364463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.364753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.368312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] PATH_INFO: `/v3/projects/8ddf0ce1d6e94620bd4493bc1762ed83` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.368312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddf0ce1d6e94620bd4493bc1762ed83)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.369009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.371135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 993/1974] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:40 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:40.372160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b3252-93c2-4d0d-b704-190e0c03bb7c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.454189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44b3252-93c2-4d0d-b704-190e0c03bb7c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.459725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.460836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.460836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.461167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.461949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.463998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.522864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddf0ce1d6e94620bd4493bc1762ed83', 'request_id': 'req-f76ec0bd-8d96-498d-b622-4725992be7cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:40.528831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddf0ce1d6e94620bd4493bc1762ed83', 'request_id': 'req-f76ec0bd-8d96-498d-b622-4725992be7cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:40.602669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 994/1975] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:40 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:40.602669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.605060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:40.633754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddf0ce1d6e94620bd4493bc1762ed83', 'request_id': 'req-f76ec0bd-8d96-498d-b622-4725992be7cc'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:40.652876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] The token cache is being invalidate because project 8ddf0ce1d6e94620bd4493bc1762ed83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:40.653242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:40.653897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:40.655788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 982/1976] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:40 2022] DELETE /identity/v3/projects/8ddf0ce1d6e94620bd4493bc1762ed83 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:40.656918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.660765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:40.697597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cc0b2-f7eb-4525-84c8-e525be36759c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.748859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ec0bd-8d96-498d-b622-4725992be7cc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.756456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.762236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.762236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.762236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.762236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.762236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.775045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 983/1977] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:40.775904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.779202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:40.780213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.781203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.781700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.782210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.785516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:40.794969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe28b7-1902-4c4a-bf8d-78b4d4eee8d5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.801185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.802461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.802461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.802729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] PATH_INFO: `/v3/users/018fa98935f04e2a9cd975930b94be87` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.803899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018fa98935f04e2a9cd975930b94be87)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.807074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.862652 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.864079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.875342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 995/1978] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:40 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:40.886381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.903636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2a279-440e-4853-9407-38d3c2a2776b service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.910540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.912210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.912210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.912589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.913483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.915332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.927002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 996/1979] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:40.931725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:40.942281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b67960c-4fb5-4ef7-898e-e09814325f41 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:40.947287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385e40a-a193-4b18-869b-eb6b3182aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:40.948459 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e40a-a193-4b18-869b-eb6b3182aa05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:40.948868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e40a-a193-4b18-869b-eb6b3182aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:40.949069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385e40a-a193-4b18-869b-eb6b3182aa05 admin admin] PATH_INFO: `/v3/projects/4f801d5180bb40f8bd0b7a9ce5b3ac09/users/d36631c07b834bd88a63414cff557382/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:40.967040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385e40a-a193-4b18-869b-eb6b3182aa05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f801d5180bb40f8bd0b7a9ce5b3ac09, user_id=d36631c07b834bd88a63414cff557382, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:40.969799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4385e40a-a193-4b18-869b-eb6b3182aa05 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:40.982459 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:41.049800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018fa98935f04e2a9cd975930b94be87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:41.084506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 997/1980] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:40 2022] PUT /identity/v3/projects/4f801d5180bb40f8bd0b7a9ce5b3ac09/users/d36631c07b834bd88a63414cff557382/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:41.094744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:41.095787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:41.096240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:41.103925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:41.171525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] MFA Rules not processed for user `d36631c07b834bd88a63414cff557382`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:41.173961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:41.210496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018fa98935f04e2a9cd975930b94be87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:41.211363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018fa98935f04e2a9cd975930b94be87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:41.236770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018fa98935f04e2a9cd975930b94be87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:41.240506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018fa98935f04e2a9cd975930b94be87'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:41.272089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 984/1981] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:40 2022] DELETE /identity/v3/users/018fa98935f04e2a9cd975930b94be87 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:41.273029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:41.278800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:41.333295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 998/1982] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:41.351968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:41.353800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:41.393703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f011e3-b624-4bae-b108-13bf6c747a15 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:41.399543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:41.401746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:41.402366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:41.403440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:41.407670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:41.463765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d9a34-0c07-4c0d-a6e8-bd12dc161a07 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:41.506327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:41.507930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:41.552936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 985/1983] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:41 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:41.602399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772901fb-9393-4c10-b29b-10f784c87a38 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:41.603227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772901fb-9393-4c10-b29b-10f784c87a38 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:41.605968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772901fb-9393-4c10-b29b-10f784c87a38 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:41.606386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772901fb-9393-4c10-b29b-10f784c87a38 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:41.683866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772901fb-9393-4c10-b29b-10f784c87a38 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:41.685756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772901fb-9393-4c10-b29b-10f784c87a38 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:41.698167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 999/1984] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:41 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:25:42.743618 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:42.822401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:43.030348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:43.032025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:43.215477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98dabe-dd0c-4aa9-b65d-560a8154eeb5 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:43.232834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:43.239400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:43.240882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:43.241202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] PATH_INFO: `/v3/projects/ba6f2bb5bf054f78bda7241cc5721e67` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:43.246893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba6f2bb5bf054f78bda7241cc5721e67)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:43.258543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:43.445227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba6f2bb5bf054f78bda7241cc5721e67', 'request_id': 'req-4fada009-88e1-4912-8803-9c09846fd2aa'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:43.453663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba6f2bb5bf054f78bda7241cc5721e67', 'request_id': 'req-4fada009-88e1-4912-8803-9c09846fd2aa'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:43.605534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba6f2bb5bf054f78bda7241cc5721e67', 'request_id': 'req-4fada009-88e1-4912-8803-9c09846fd2aa'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:43.644367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] The token cache is being invalidate because project ba6f2bb5bf054f78bda7241cc5721e67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:43.644715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:43.675337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4fada009-88e1-4912-8803-9c09846fd2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:43.680192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 986/1985] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:43 2022] DELETE /identity/v3/projects/ba6f2bb5bf054f78bda7241cc5721e67 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:43.685492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaba75-a908-4824-b79c-7c06c9923fe5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:43.685958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaba75-a908-4824-b79c-7c06c9923fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:43.686403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eaba75-a908-4824-b79c-7c06c9923fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:43.711314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e7eaba75-a908-4824-b79c-7c06c9923fe5 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:43.713024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e7eaba75-a908-4824-b79c-7c06c9923fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:43.825317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1000/1986] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:43.833288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:43.833988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb49a64-4d3b-4ac7-9f0b-538376533c55 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:43.834463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb49a64-4d3b-4ac7-9f0b-538376533c55 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:43.834766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb49a64-4d3b-4ac7-9f0b-538376533c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:43.886234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6cb49a64-4d3b-4ac7-9f0b-538376533c55 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:43.888111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6cb49a64-4d3b-4ac7-9f0b-538376533c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:43.908300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 987/1987] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:43.912377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaba75-a908-4824-b79c-7c06c9923fe5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:43.933743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eaba75-a908-4824-b79c-7c06c9923fe5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:43.949518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:43.950358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:43.950653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:43.950971 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:43.951756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:43.952091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:43.956995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:43.995847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1001/1988] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:43.997188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb49a64-4d3b-4ac7-9f0b-538376533c55 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:44.016289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb49a64-4d3b-4ac7-9f0b-538376533c55 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:44.018588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:44.019367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:44.020715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:44.020715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:44.020715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:44.022873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:44.126991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 988/1989] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:43 2022] POST /identity/v3/projects => generated 401 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:44.141313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:44.155491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcee6cf-80cb-4cd8-a683-13b00e76e628 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:44.260959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:44.261946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:44.262241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:44.262862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:44.263604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:44.265890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:44.367496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1002/1990] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:44 2022] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:44.369514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:44.396500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6c8cf-8171-45b0-8f00-02a06b077d5f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:44.410857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:44.411575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:44.411863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:44.412142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:44.413080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:44.417707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:44.434942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 989/1991] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:44.439758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:44.441243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:44.459934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df40bb7-6561-41b5-a260-3d5468342018 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:44.473460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43182a8a-52aa-4ad4-bbb2-0bf9c2700799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:44.477304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43182a8a-52aa-4ad4-bbb2-0bf9c2700799 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:44.478589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43182a8a-52aa-4ad4-bbb2-0bf9c2700799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:44.478862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43182a8a-52aa-4ad4-bbb2-0bf9c2700799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:44.479838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43182a8a-52aa-4ad4-bbb2-0bf9c2700799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:44.489412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43182a8a-52aa-4ad4-bbb2-0bf9c2700799 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:44.529481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:44.530106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1003/1992] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:44.546969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d3dab-916e-4f49-91dd-e74cdb3a112a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:44.562523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:44.563578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:44.564116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:44.564687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] PATH_INFO: `/v3/projects/ab6c6d5eb1744df8a68e36afdd642edd/users/96f858ba41b24f538551850212712fc6/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:44.607300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab6c6d5eb1744df8a68e36afdd642edd, user_id=96f858ba41b24f538551850212712fc6, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:44.610614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:44.789760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7a82-e6a5-48e1-851d-e66b57cb75b9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:44.790076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7a82-e6a5-48e1-851d-e66b57cb75b9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:44.790530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f7a82-e6a5-48e1-851d-e66b57cb75b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:44.792132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 990/1993] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:44 2022] PUT /identity/v3/projects/ab6c6d5eb1744df8a68e36afdd642edd/users/96f858ba41b24f538551850212712fc6/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:44.874631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ff5f7a82-e6a5-48e1-851d-e66b57cb75b9 None None] MFA Rules not processed for user `96f858ba41b24f538551850212712fc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:44.875261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff5f7a82-e6a5-48e1-851d-e66b57cb75b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:45.127515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1004/1994] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:45.130800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:45.303260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd18a7f-cc44-4b2b-b7b2-e7d754d7660f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:45.313791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:45.315859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:45.316779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:45.317312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:45.318223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:45.322717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:45.437460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 991/1995] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:45 2022] POST /identity/v3/projects => generated 399 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:45.441747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7a82-e6a5-48e1-851d-e66b57cb75b9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:45.458644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5f7a82-e6a5-48e1-851d-e66b57cb75b9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:45.589807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:45.591986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:45.591986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:45.591986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:45.591986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:45.593759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:45.708291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1005/1996] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:45 2022] POST /identity/v3/users => generated 306 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:45.708867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:45.724528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9d7c1-6bb5-4feb-9f8d-db25db48e66b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:45.756192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:45.756938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:45.757261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:45.757544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:45.758289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:45.762578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:45.790140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 992/1997] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:45.794104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:45.807963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47840ad6-2739-4564-b7d7-924a2709040b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:45.813119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:45.814296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:45.814732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:45.815279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] PATH_INFO: `/v3/projects/e3baa140d5a64ee7849462cbb2472e05/users/08a9ea6986e04619b722120f8c7c26af/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:45.840087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3baa140d5a64ee7849462cbb2472e05, user_id=08a9ea6986e04619b722120f8c7c26af, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:45.843134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:45.972660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1006/1998] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:45 2022] PUT /identity/v3/projects/e3baa140d5a64ee7849462cbb2472e05/users/08a9ea6986e04619b722120f8c7c26af/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:45.979874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:45.997781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d26c9-3c71-486f-8c0e-a95b6c6ebafd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:46.163427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afab0be-cfec-4e76-9011-826fce7587c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:46.170865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab0be-cfec-4e76-9011-826fce7587c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:46.170865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab0be-cfec-4e76-9011-826fce7587c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:46.170865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afab0be-cfec-4e76-9011-826fce7587c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:46.170865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab0be-cfec-4e76-9011-826fce7587c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:46.170865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afab0be-cfec-4e76-9011-826fce7587c3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:46.185800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 993/1999] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:46.190028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:46.201608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fac98-dd1d-4b45-a2c6-a484978188ac admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:46.206868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:46.210993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:46.211331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:46.211622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] PATH_INFO: `/v3/projects/e3baa140d5a64ee7849462cbb2472e05/users/08a9ea6986e04619b722120f8c7c26af/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:46.214363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3baa140d5a64ee7849462cbb2472e05, user_id=08a9ea6986e04619b722120f8c7c26af, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:46.217239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:46.230114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1007/2000] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:46 2022] PUT /identity/v3/projects/e3baa140d5a64ee7849462cbb2472e05/users/08a9ea6986e04619b722120f8c7c26af/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:46.241782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139683-8b2b-4181-81d7-0d24fe1fa712 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:46.242092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139683-8b2b-4181-81d7-0d24fe1fa712 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:46.242360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34139683-8b2b-4181-81d7-0d24fe1fa712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:46.252361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:46.290130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-34139683-8b2b-4181-81d7-0d24fe1fa712 None None] MFA Rules not processed for user `08a9ea6986e04619b722120f8c7c26af`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:46.293927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34139683-8b2b-4181-81d7-0d24fe1fa712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:46.409504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 994/2001] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:46.422037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:46.424114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:46.501175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc962af-6b6a-46e8-aa6e-6ce2befcdca7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:46.505909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:46.506933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:46.507296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:46.507639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:46.531238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:46.533728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:46.549226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1008/2002] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:46.748087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:46.771468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139683-8b2b-4181-81d7-0d24fe1fa712 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:46.781759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34139683-8b2b-4181-81d7-0d24fe1fa712 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:46.790524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fca0a-32cc-425f-ab77-00bffe47b334 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:46.791661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fca0a-32cc-425f-ab77-00bffe47b334 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:46.799060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fca0a-32cc-425f-ab77-00bffe47b334 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:46.799060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fca0a-32cc-425f-ab77-00bffe47b334 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:46.886793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fca0a-32cc-425f-ab77-00bffe47b334 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:46.886793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fca0a-32cc-425f-ab77-00bffe47b334 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:46.890749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 995/2003] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:46 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:47.274034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:48.989038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:50.056470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:50.313364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:50.930534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:51.228675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:52.491317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:52.673733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:52.821774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:53.164209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:53.284546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:53.374575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:53.443241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab42e286-8b6f-4049-97f2-953e28ee3ce3 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:53.447908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:53.448817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:53.449139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:53.449406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] PATH_INFO: `/v3/users/96f858ba41b24f538551850212712fc6` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:53.450675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f858ba41b24f538551850212712fc6)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:53.452588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:53.698121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f858ba41b24f538551850212712fc6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:53.715131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f858ba41b24f538551850212712fc6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:53.723406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f858ba41b24f538551850212712fc6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:53.838735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f858ba41b24f538551850212712fc6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:53.839369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f858ba41b24f538551850212712fc6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:53.846711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1009/2004] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:53 2022] DELETE /identity/v3/users/96f858ba41b24f538551850212712fc6 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:53.851479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:53.852051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:53.852161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:53.875338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:53.877666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:53.953296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 996/2005] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:53.965185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:53.966599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:54.036488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1406af8-b728-4960-9eb2-9a309768249a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:54.041105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:54.042291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:54.042291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:54.042493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:54.054774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:54.058283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:54.068112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1010/2006] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:54.078829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:54.238801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:54.672386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:54.673569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:54.687878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dca07-84f8-44fc-9f5d-636bf85255de None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:54.693898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:54.694855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:54.702227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:54.702227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] PATH_INFO: `/v3/projects/ab6c6d5eb1744df8a68e36afdd642edd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:54.702227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab6c6d5eb1744df8a68e36afdd642edd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:54.702227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:54.825039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab6c6d5eb1744df8a68e36afdd642edd', 'request_id': 'req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:54.827528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:54.831395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab6c6d5eb1744df8a68e36afdd642edd', 'request_id': 'req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:54.909368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab6c6d5eb1744df8a68e36afdd642edd', 'request_id': 'req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:54.927647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] The token cache is being invalidate because project ab6c6d5eb1744df8a68e36afdd642edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:54.928062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:54.929183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:54.931846 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 997/2007] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:54 2022] DELETE /identity/v3/projects/ab6c6d5eb1744df8a68e36afdd642edd => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:54.936737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:54.956121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c028c1-fad2-4847-8e63-eff7964c48fe service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:55.080247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:55.081969 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:55.082615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:55.083081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] PATH_INFO: `/v3/users/08a9ea6986e04619b722120f8c7c26af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:55.085452 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08a9ea6986e04619b722120f8c7c26af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:55.087950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:55.240102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:55.331566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:55.362038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08a9ea6986e04619b722120f8c7c26af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:55.393215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08a9ea6986e04619b722120f8c7c26af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:55.408644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08a9ea6986e04619b722120f8c7c26af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:55.461907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08a9ea6986e04619b722120f8c7c26af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:55.463825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d885521-1bec-461f-9ed2-66269cf77b89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08a9ea6986e04619b722120f8c7c26af'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:55.474279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1011/2008] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:25:54 2022] DELETE /identity/v3/users/08a9ea6986e04619b722120f8c7c26af => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:56.081553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:56.234195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:56.237066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:56.259494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ea86-0f79-4983-83ce-bfbb6ba3bd58 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:56.354937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:56.355898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:56.356185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:56.356456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] PATH_INFO: `/v3/projects/e3baa140d5a64ee7849462cbb2472e05` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:56.358512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3baa140d5a64ee7849462cbb2472e05)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:56.363241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:56.400927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:56.579581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3baa140d5a64ee7849462cbb2472e05', 'request_id': 'req-1b204bd0-6da8-4c46-bf63-5f21ca613da8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:56.617242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3baa140d5a64ee7849462cbb2472e05', 'request_id': 'req-1b204bd0-6da8-4c46-bf63-5f21ca613da8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:56.747599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3baa140d5a64ee7849462cbb2472e05', 'request_id': 'req-1b204bd0-6da8-4c46-bf63-5f21ca613da8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:56.762319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] The token cache is being invalidate because project e3baa140d5a64ee7849462cbb2472e05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:25:56.762584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:56.763205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-1b204bd0-6da8-4c46-bf63-5f21ca613da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:25:56.764795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 998/2009] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:25:56 2022] DELETE /identity/v3/projects/e3baa140d5a64ee7849462cbb2472e05 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:56.770750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195fdc2-e6b4-452e-a40b-2c8bf0080463 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:56.771211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195fdc2-e6b4-452e-a40b-2c8bf0080463 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:56.771492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195fdc2-e6b4-452e-a40b-2c8bf0080463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:56.807065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5195fdc2-e6b4-452e-a40b-2c8bf0080463 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:56.809538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5195fdc2-e6b4-452e-a40b-2c8bf0080463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:56.905051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1012/2010] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:56.909795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df345cae-6d35-4dd7-b995-355b304b758b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:56.910439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df345cae-6d35-4dd7-b995-355b304b758b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:56.910928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df345cae-6d35-4dd7-b995-355b304b758b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:56.939514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-df345cae-6d35-4dd7-b995-355b304b758b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:56.942385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df345cae-6d35-4dd7-b995-355b304b758b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:56.957793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 999/2011] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:25:56.962947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195fdc2-e6b4-452e-a40b-2c8bf0080463 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:56.993436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195fdc2-e6b4-452e-a40b-2c8bf0080463 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:56.993436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:56.993436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:56.993436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:56.994023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:56.994023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:25:56.994023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:56.998622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:57.015033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1013/2012] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:25:57.019187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df345cae-6d35-4dd7-b995-355b304b758b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:57.033421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df345cae-6d35-4dd7-b995-355b304b758b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:57.039661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:57.042088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:57.042600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:57.043135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:57.044476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:57.047338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:57.056730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:57.189395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1000/2013] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:57 2022] POST /identity/v3/projects => generated 409 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:57.191554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:57.204599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4550ddf-38b7-43c0-93e2-fe433c107295 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:57.303816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:57.304790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:57.305291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:57.305735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:57.306950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:57.310618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:57.406727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1014/2014] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:57 2022] POST /identity/v3/users => generated 305 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:25:57.411831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:57.423918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4971e80-2f70-4734-8670-32456c90ad64 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:57.430336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:57.431133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:57.431530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:57.432035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:57.432912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:57.440607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:57.446954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1001/2015] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:57.452595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:57.464313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050362c1-5e40-4721-afcf-6307e228a2c3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:57.470644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075744-abbc-4bac-b2e1-9e9f9181945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:57.471841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075744-abbc-4bac-b2e1-9e9f9181945b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:57.472151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075744-abbc-4bac-b2e1-9e9f9181945b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:57.472430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075744-abbc-4bac-b2e1-9e9f9181945b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:57.473211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075744-abbc-4bac-b2e1-9e9f9181945b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:57.475639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075744-abbc-4bac-b2e1-9e9f9181945b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:57.488491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1015/2016] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:57.495233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:57.514242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fba0f-205e-430b-8cf3-78a63cf482b4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:57.520199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:57.521214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:57.521490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:57.521983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] PATH_INFO: `/v3/projects/9fc23ddb520643108e381fb3cc57dc50/users/4d0d1e120a704c61bbbb1b1fb4fb7f48/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:57.542714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc23ddb520643108e381fb3cc57dc50, user_id=4d0d1e120a704c61bbbb1b1fb4fb7f48, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:57.545792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:57.682406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1002/2017] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:57 2022] PUT /identity/v3/projects/9fc23ddb520643108e381fb3cc57dc50/users/4d0d1e120a704c61bbbb1b1fb4fb7f48/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:57.685021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330007d1-af98-4321-a95f-1aa31881acba None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:57.686551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330007d1-af98-4321-a95f-1aa31881acba None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:57.686734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330007d1-af98-4321-a95f-1aa31881acba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:57.761867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-330007d1-af98-4321-a95f-1aa31881acba None None] MFA Rules not processed for user `4d0d1e120a704c61bbbb1b1fb4fb7f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:57.775566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-330007d1-af98-4321-a95f-1aa31881acba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:57.960621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1016/2018] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:57 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:57.965203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:58.069646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e59841-efa4-48c4-97d4-1bdf0d076f32 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:58.075910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:58.076587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:58.077089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:58.077846 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:58.084571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:58.084571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:58.216027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1003/2019] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:25:57 2022] POST /identity/v3/projects => generated 405 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:58.216711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330007d1-af98-4321-a95f-1aa31881acba None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:58.223743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:58.246492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330007d1-af98-4321-a95f-1aa31881acba None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:58.287025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:58.390376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:58.391447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:58.391709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:58.392619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:58.393612 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:58.395588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:58.478556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1017/2020] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:25:58 2022] POST /identity/v3/users => generated 309 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:25:58.482696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:58.498557 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259df533-2dd3-467e-8da8-5090f810b047 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:58.505499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:58.511001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:58.511001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:58.511001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:58.511001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:58.512039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:58.537036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1004/2021] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:58.539351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:58.550105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ebda38-bb51-41ae-839b-cc9a2aed590b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:58.555743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:58.556653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:58.558120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:58.558120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] PATH_INFO: `/v3/projects/843ea97e5f9540bf8aae4363a320a215/users/cf04db197da347daba09e4aec36328ce/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:58.575448 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] RBAC: Authorizing `identity:create_grant(project_id=843ea97e5f9540bf8aae4363a320a215, user_id=cf04db197da347daba09e4aec36328ce, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:58.580016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:58.679487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1018/2022] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:58 2022] PUT /identity/v3/projects/843ea97e5f9540bf8aae4363a320a215/users/cf04db197da347daba09e4aec36328ce/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:25:58.685558 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:58.702789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff8a692-a6df-48d2-a359-d3eb7629ba52 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:58.775180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b2340-0222-4911-9a01-7e412b34eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:58.775980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b2340-0222-4911-9a01-7e412b34eddf admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:58.776339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b2340-0222-4911-9a01-7e412b34eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:58.776689 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b2340-0222-4911-9a01-7e412b34eddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:58.777606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b2340-0222-4911-9a01-7e412b34eddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:58.779473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b2340-0222-4911-9a01-7e412b34eddf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:58.796620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1005/2023] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:25:58.798450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:58.817997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f5cf2-9f46-4df7-8c76-b4d874f3083e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:58.830987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:58.832301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:58.832817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:58.833613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] PATH_INFO: `/v3/projects/843ea97e5f9540bf8aae4363a320a215/users/cf04db197da347daba09e4aec36328ce/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:58.836964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843ea97e5f9540bf8aae4363a320a215, user_id=cf04db197da347daba09e4aec36328ce, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:58.847521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:58.863520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1019/2024] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:25:58 2022] PUT /identity/v3/projects/843ea97e5f9540bf8aae4363a320a215/users/cf04db197da347daba09e4aec36328ce/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:25:58.874362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:58.874669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:58.875138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:58.929655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] MFA Rules not processed for user `cf04db197da347daba09e4aec36328ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:25:58.931031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:59.083415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1006/2025] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:25:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:25:59.100383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:59.105096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:59.128498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:59.279079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:59.311084 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8c071-7afd-41fb-82b3-983d6ab28234 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:59.315846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2064d-e2f2-4869-9959-98bfc87821fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:59.319738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2064d-e2f2-4869-9959-98bfc87821fa service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:59.320129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2064d-e2f2-4869-9959-98bfc87821fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:59.321341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2064d-e2f2-4869-9959-98bfc87821fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:25:59.333291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2064d-e2f2-4869-9959-98bfc87821fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:25:59.339476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2064d-e2f2-4869-9959-98bfc87821fa service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:25:59.347512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1020/2026] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:25:59.596589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:25:59.946175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:25:59.948663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:25:59.968173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc591b0-8e98-4485-8130-396b5299ea9b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:25:59.972078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248ca7a1-371f-4f47-804b-c3e769ef61c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:25:59.972747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca7a1-371f-4f47-804b-c3e769ef61c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:25:59.973123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca7a1-371f-4f47-804b-c3e769ef61c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:25:59.973366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248ca7a1-371f-4f47-804b-c3e769ef61c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:00.050861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ca7a1-371f-4f47-804b-c3e769ef61c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:00.052311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248ca7a1-371f-4f47-804b-c3e769ef61c0 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:00.061804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1007/2027] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:25:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:00.067706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:00.181187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b162e-46d2-46e3-9983-d910adcb8ed1 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:00.182295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b162e-46d2-46e3-9983-d910adcb8ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:00.182295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b162e-46d2-46e3-9983-d910adcb8ed1 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:00.185348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1021/2028] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:26:00.195002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71736018-6697-447a-9832-bf7c11230b0a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:00.195735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71736018-6697-447a-9832-bf7c11230b0a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:00.196105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71736018-6697-447a-9832-bf7c11230b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:00.240870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-71736018-6697-447a-9832-bf7c11230b0a None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:00.243477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-71736018-6697-447a-9832-bf7c11230b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:00.274729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:00.325615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1008/2029] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:26:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:00.339722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b162e-46d2-46e3-9983-d910adcb8ed1 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:00.340417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4e5b162e-46d2-46e3-9983-d910adcb8ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:00.369238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b162e-46d2-46e3-9983-d910adcb8ed1 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:00.374334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71736018-6697-447a-9832-bf7c11230b0a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:00.376784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-71736018-6697-447a-9832-bf7c11230b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:00.378577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:00.379931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:00.380438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:00.380873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:00.391911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:00.394260 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:00.412096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1022/2030] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:00.464327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71736018-6697-447a-9832-bf7c11230b0a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:00.470603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:00.471595 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:00.471875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:00.472152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] PATH_INFO: `/v3/users/1a4d9b43b40842ffb3ae76dd6dfef305` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:00.473448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a4d9b43b40842ffb3ae76dd6dfef305)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:00.475391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:00.781749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:00.975156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a4d9b43b40842ffb3ae76dd6dfef305'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:01.093188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a4d9b43b40842ffb3ae76dd6dfef305'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:01.094218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a4d9b43b40842ffb3ae76dd6dfef305'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:01.112911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a4d9b43b40842ffb3ae76dd6dfef305'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:01.114023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-86f4bb83-57a0-42bd-b24c-96d4090acebc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a4d9b43b40842ffb3ae76dd6dfef305'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:01.130784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1009/2031] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:00 2022] DELETE /identity/v3/users/1a4d9b43b40842ffb3ae76dd6dfef305 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:01.620466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:01.644220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ed419-6ede-47ee-a21d-74143ad2ebf0 service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:01.719458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:01.720632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:01.720927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:01.721244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] PATH_INFO: `/v3/projects/e9f2e448b914421bbff31e0aa9478b67` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:01.722559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9f2e448b914421bbff31e0aa9478b67)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:01.724595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:01.787924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:01.868858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9f2e448b914421bbff31e0aa9478b67', 'request_id': 'req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:01.874720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9f2e448b914421bbff31e0aa9478b67', 'request_id': 'req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:01.880745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:02.016150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9f2e448b914421bbff31e0aa9478b67', 'request_id': 'req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:02.032218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] The token cache is being invalidate because project e9f2e448b914421bbff31e0aa9478b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:02.032538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:02.033294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ac8c8813-0e3f-4e13-b6d4-307d7894fe14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:02.034858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1023/2032] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:01 2022] DELETE /identity/v3/projects/e9f2e448b914421bbff31e0aa9478b67 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:02.040311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491f05-5758-4832-93b9-59e229a043f6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.040847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491f05-5758-4832-93b9-59e229a043f6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.040847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08491f05-5758-4832-93b9-59e229a043f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.065794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-08491f05-5758-4832-93b9-59e229a043f6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:02.067019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-08491f05-5758-4832-93b9-59e229a043f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:02.162251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1010/2033] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:02.170845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3499f-0d2f-47d7-a5f9-160f34da3ec9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.171240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3499f-0d2f-47d7-a5f9-160f34da3ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.172280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3499f-0d2f-47d7-a5f9-160f34da3ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.208684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1af3499f-0d2f-47d7-a5f9-160f34da3ec9 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:02.210063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1af3499f-0d2f-47d7-a5f9-160f34da3ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:02.227663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1024/2034] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:02.233873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08491f05-5758-4832-93b9-59e229a043f6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:02.260878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08491f05-5758-4832-93b9-59e229a043f6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:02.270746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:02.272105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.272467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.275957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.275957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:02.275957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:02.277493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:02.301157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1011/2035] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:26:02.308466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3499f-0d2f-47d7-a5f9-160f34da3ec9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:02.320318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3499f-0d2f-47d7-a5f9-160f34da3ec9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:02.325987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:02.329919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.332239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.332239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.332239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:02.336250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:02.477291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1025/2036] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:02 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:02.478935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:02.491132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90beae1e-a7d7-4fc0-9077-22ff2f3a3a07 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:02.560908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:02.561657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.562147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.562524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.563338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:02.565400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:02.725726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1012/2037] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:02 2022] POST /identity/v3/users => generated 295 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:02.729989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:02.741523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8f422-3d8c-4f3f-ba21-91f9b6dcd05c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:02.747319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:02.748026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.748347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.748661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.749513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:02.751672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:02.756292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:02.765905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1026/2038] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:26:02.770881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:02.782139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f53310-0fda-4e56-a291-7bc6cc15f615 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:02.787486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40beb0a6-adaa-4b0e-9f5c-65eabe84912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:02.788164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb0a6-adaa-4b0e-9f5c-65eabe84912c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.788452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb0a6-adaa-4b0e-9f5c-65eabe84912c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.788809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40beb0a6-adaa-4b0e-9f5c-65eabe84912c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.789966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beb0a6-adaa-4b0e-9f5c-65eabe84912c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:02.791224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40beb0a6-adaa-4b0e-9f5c-65eabe84912c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:02.802829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1013/2039] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:02.807464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:02.818172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c74896-7a81-4793-ad47-a0fac690af0f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:02.823783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:02.824234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:02.824520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:02.824798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] PATH_INFO: `/v3/projects/ecf7fe2f238b417a80fbec03b7a90f51/users/6b6c6957d1d54119bbb240a4bfda4b31/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:02.844651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf7fe2f238b417a80fbec03b7a90f51, user_id=6b6c6957d1d54119bbb240a4bfda4b31, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:02.848395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:03.000586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1027/2040] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:02 2022] PUT /identity/v3/projects/ecf7fe2f238b417a80fbec03b7a90f51/users/6b6c6957d1d54119bbb240a4bfda4b31/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:03.009056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:03.009674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:03.010237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:03.046311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:03.049686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:03.133009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:03.155516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1014/2041] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:03.168268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:03.170700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:03.235985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04de37-496c-444d-9686-e762a979b99d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:03.240297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0158f0b-0ef0-456d-9f09-901f3a524b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:03.241015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158f0b-0ef0-456d-9f09-901f3a524b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:03.241293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158f0b-0ef0-456d-9f09-901f3a524b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:03.241568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0158f0b-0ef0-456d-9f09-901f3a524b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:03.275026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0158f0b-0ef0-456d-9f09-901f3a524b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:03.275026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0158f0b-0ef0-456d-9f09-901f3a524b09 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:03.305737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1028/2042] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:26:03.469586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:04.902355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:04.904438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:04.922460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694960cd-d931-44d5-b40a-77ce372d7927 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:04.928532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:04.929435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:04.929960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:04.930394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] PATH_INFO: `/v3/users/e7f50310111f4426ab02c728022c1b00` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:04.932573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7f50310111f4426ab02c728022c1b00)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:04.934877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:05.226422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7f50310111f4426ab02c728022c1b00'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:05.353288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7f50310111f4426ab02c728022c1b00'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:05.353809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7f50310111f4426ab02c728022c1b00'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:05.373850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:05.377299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7f50310111f4426ab02c728022c1b00'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:05.378777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7f50310111f4426ab02c728022c1b00'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:05.413373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1015/2043] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:04 2022] DELETE /identity/v3/users/e7f50310111f4426ab02c728022c1b00 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:05.416202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9bc7c-63ea-41a7-8e12-62b1f5963d12 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:05.416721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9bc7c-63ea-41a7-8e12-62b1f5963d12 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:05.417245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9bc7c-63ea-41a7-8e12-62b1f5963d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:05.458006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cbd9bc7c-63ea-41a7-8e12-62b1f5963d12 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:05.460877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cbd9bc7c-63ea-41a7-8e12-62b1f5963d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:05.617859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1029/2044] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:05.633401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:05.635024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:05.744778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f609b3-bd31-408d-bed0-047983cd60fd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:05.752382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:05.754999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:05.755493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:05.756224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:05.769991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:05.771755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:05.786193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1016/2045] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:06.378109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:06.378109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:06.378109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:06.427927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:06.430775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:06.527136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1030/2046] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:26:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:06.587378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:06.589158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:06.714820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306cf5bc-6983-4315-8114-e06633d60aa2 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:06.723384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:06.724427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:06.724878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:06.725371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:06.738133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:06.741359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:06.757977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1017/2047] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:26:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 06:26:06.769090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:06.771649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:06.803611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb661b0e-c8a3-4dba-a41b-a8ec6f25273b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:06.809624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:06.820464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:06.820464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:06.820464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] PATH_INFO: `/v3/projects/e846cee08c9f49bd9811856edbff6b17` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:06.820464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e846cee08c9f49bd9811856edbff6b17)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:06.820464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:06.820464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:07.072235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e846cee08c9f49bd9811856edbff6b17', 'request_id': 'req-7663397f-c2ac-4445-abbd-c4f6c779350d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.079268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e846cee08c9f49bd9811856edbff6b17', 'request_id': 'req-7663397f-c2ac-4445-abbd-c4f6c779350d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.244888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e846cee08c9f49bd9811856edbff6b17', 'request_id': 'req-7663397f-c2ac-4445-abbd-c4f6c779350d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.278045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] The token cache is being invalidate because project e846cee08c9f49bd9811856edbff6b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:07.281599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.284959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7663397f-c2ac-4445-abbd-c4f6c779350d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.289381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1031/2048] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:06 2022] DELETE /identity/v3/projects/e846cee08c9f49bd9811856edbff6b17 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:07.298920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:07.322765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e42951-aed0-433c-88b8-7c644e58e6c5 service swift] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:07.505079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:07.506399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:07.507038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:07.507333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] PATH_INFO: `/v3/users/9b193aa788e64d04865f6def39e55175` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:07.508824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b193aa788e64d04865f6def39e55175)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:07.511026 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:07.709473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:07.724549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b193aa788e64d04865f6def39e55175'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.851419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b193aa788e64d04865f6def39e55175'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.854646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b193aa788e64d04865f6def39e55175'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.882609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b193aa788e64d04865f6def39e55175'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.884020 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b193aa788e64d04865f6def39e55175'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:07.907778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1018/2049] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:07 2022] DELETE /identity/v3/users/9b193aa788e64d04865f6def39e55175 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:08.420414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:08.421049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:08.421847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:08.517267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:08.521248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:08.729610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1032/2050] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 18 06:26:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:08.740904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:08.745371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:08.842561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:08.845570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:08.940353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1665f-c0d2-4a68-bf4b-2c2f055706ad admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:08.949528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ae350-4ae7-4d8f-a9e5-65200a4d89f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:08.950655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ae350-4ae7-4d8f-a9e5-65200a4d89f6 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:08.951170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ae350-4ae7-4d8f-a9e5-65200a4d89f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:08.951675 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ae350-4ae7-4d8f-a9e5-65200a4d89f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:08.970035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ae350-4ae7-4d8f-a9e5-65200a4d89f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:08.970862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ae350-4ae7-4d8f-a9e5-65200a4d89f6 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:08.990126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1019/2051] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:26:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:26:08.990875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d566e-df3b-4f29-9bf4-bfa09245cf45 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:09.004654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:09.004654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:09.004654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:09.004654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] PATH_INFO: `/v3/projects/2ac994515cd641d8a86b2e4e4e2e7663` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:09.005156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac994515cd641d8a86b2e4e4e2e7663)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:09.005156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:09.234659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:09.257556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac994515cd641d8a86b2e4e4e2e7663', 'request_id': 'req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:09.271490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac994515cd641d8a86b2e4e4e2e7663', 'request_id': 'req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:09.364506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac994515cd641d8a86b2e4e4e2e7663', 'request_id': 'req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:09.381426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] The token cache is being invalidate because project 2ac994515cd641d8a86b2e4e4e2e7663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:09.382026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:09.382859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-85bf8a65-9a95-4303-aec2-7ea2aaaf9ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:09.384680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1033/2052] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:08 2022] DELETE /identity/v3/projects/2ac994515cd641d8a86b2e4e4e2e7663 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:09.390501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73748f-30d8-4aa7-85ec-70722dc6df68 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:09.390844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73748f-30d8-4aa7-85ec-70722dc6df68 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:09.391284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73748f-30d8-4aa7-85ec-70722dc6df68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:09.413188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-bd73748f-30d8-4aa7-85ec-70722dc6df68 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:09.414446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd73748f-30d8-4aa7-85ec-70722dc6df68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:09.530079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1020/2053] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:09.542420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:09.542848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:09.543300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:09.597681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:09.601127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:09.630377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1034/2054] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:09.631324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73748f-30d8-4aa7-85ec-70722dc6df68 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:09.654280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73748f-30d8-4aa7-85ec-70722dc6df68 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:09.688247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:09.689557 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:09.689906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:09.690644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:09.693287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:09.693875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:09.697678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:09.738960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:09.740643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:09.761184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1021/2055] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:26:09.767921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:09.783120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82493475-b38b-459f-a9dd-52decfac31fc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:09.792635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23076693-0e88-437b-87bc-2e3b8799494e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:09.804020 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:09.806249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:09.809617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:09.810192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:09.811112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:09.811602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:09.812207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:09.812511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] PATH_INFO: `/v3/users/4d0d1e120a704c61bbbb1b1fb4fb7f48` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:09.815330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d0d1e120a704c61bbbb1b1fb4fb7f48)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:09.816166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:09.818913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:09.820265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:09.862803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:10.014348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1022/2056] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:09 2022] POST /identity/v3/projects => generated 363 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:10.020870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:10.127339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d0d1e120a704c61bbbb1b1fb4fb7f48'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:10.149821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1a5077-e270-439a-ab91-3adc577ad63f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:10.162272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833874c-9124-4095-8df4-d8e35c90f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:10.163416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833874c-9124-4095-8df4-d8e35c90f58f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.164373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833874c-9124-4095-8df4-d8e35c90f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.164819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833874c-9124-4095-8df4-d8e35c90f58f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.165788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833874c-9124-4095-8df4-d8e35c90f58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:10.168564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d0d1e120a704c61bbbb1b1fb4fb7f48'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:10.168949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833874c-9124-4095-8df4-d8e35c90f58f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:10.191630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d0d1e120a704c61bbbb1b1fb4fb7f48'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:10.317613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1023/2057] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:10 2022] POST /identity/v3/users => generated 282 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:10.319586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb6f9-f006-434b-8b06-b5d6dabaec5e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.320043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb6f9-f006-434b-8b06-b5d6dabaec5e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.320565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abb6f9-f006-434b-8b06-b5d6dabaec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.337296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d0d1e120a704c61bbbb1b1fb4fb7f48'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:10.343381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d0d1e120a704c61bbbb1b1fb4fb7f48'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:10.351408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1035/2058] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:09 2022] DELETE /identity/v3/users/4d0d1e120a704c61bbbb1b1fb4fb7f48 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:10.356149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:10.365059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:10.387008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-58abb6f9-f006-434b-8b06-b5d6dabaec5e None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:10.390053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-58abb6f9-f006-434b-8b06-b5d6dabaec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:10.534240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1024/2059] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:26:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:10.536438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c0e9b-bab8-4cd0-95bb-1b8e55aae913 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.537051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c0e9b-bab8-4cd0-95bb-1b8e55aae913 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.537640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c0e9b-bab8-4cd0-95bb-1b8e55aae913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.578598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4a7c0e9b-bab8-4cd0-95bb-1b8e55aae913 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:10.578598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a7c0e9b-bab8-4cd0-95bb-1b8e55aae913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:10.602875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a765471-ee1f-4725-a327-198d30388bcd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:10.617944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:10.619251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.625289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.625289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.625289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:10.625289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:10.645646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1036/2060] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:10.647194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:10.650814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:10.742003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1025/2061] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:10.746576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c0e9b-bab8-4cd0-95bb-1b8e55aae913 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:10.758537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c0e9b-bab8-4cd0-95bb-1b8e55aae913 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:10.764069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:10.764881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.765185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.765462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.766212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:10.769252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:10.781585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1026/2062] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:10.781585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:10.781585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:10.871245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332d152-4f97-4536-975b-0bcb956e1179 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:10.880182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:10.880847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.881166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.881447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.907017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:10.910001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:10.916665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4182974-1168-44b0-9565-39e1b6c03ae6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:10.928253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1027/2063] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:10.929442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:10.945488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1618f-b96a-47c4-a9eb-d55ba1dd547a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:10.947184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1618f-b96a-47c4-a9eb-d55ba1dd547a service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.947419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab0884-b6f1-4f96-9ca3-d00ac3c3010f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:10.947717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1618f-b96a-47c4-a9eb-d55ba1dd547a service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.948133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1618f-b96a-47c4-a9eb-d55ba1dd547a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.956620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817623-f219-4e76-9364-22913726891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:10.957393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817623-f219-4e76-9364-22913726891c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:10.957879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817623-f219-4e76-9364-22913726891c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:10.958357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65817623-f219-4e76-9364-22913726891c admin admin] PATH_INFO: `/v3/projects/656adb01d6f54792bc2e67e116432582/users/4298dc45dca74510ae9158ee7df457ab/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:10.969201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1618f-b96a-47c4-a9eb-d55ba1dd547a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:10.978625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1618f-b96a-47c4-a9eb-d55ba1dd547a service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:11.012383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1037/2064] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:26:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:26:11.024688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817623-f219-4e76-9364-22913726891c admin admin] RBAC: Authorizing `identity:create_grant(project_id=656adb01d6f54792bc2e67e116432582, user_id=4298dc45dca74510ae9158ee7df457ab, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:11.033205 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65817623-f219-4e76-9364-22913726891c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:11.216261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1028/2065] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:10 2022] PUT /identity/v3/projects/656adb01d6f54792bc2e67e116432582/users/4298dc45dca74510ae9158ee7df457ab/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:11.228780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:11.229147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:11.229439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:11.338622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] MFA Rules not processed for user `4298dc45dca74510ae9158ee7df457ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:11.340000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:11.488910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1038/2066] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:11.494054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817623-f219-4e76-9364-22913726891c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:11.616360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:11.701779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65817623-f219-4e76-9364-22913726891c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:11.716094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:11.720761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:11.721576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:11.721948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:11.723869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:11.730599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:11.758358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:11.760229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:11.807695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe64cac-c4e8-486d-bb36-e382121a7fae None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:11.819626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:11.821469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:11.821975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:11.822471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] PATH_INFO: `/v3/projects/9fc23ddb520643108e381fb3cc57dc50` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:11.825872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc23ddb520643108e381fb3cc57dc50)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:11.834792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:11.930068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1029/2067] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:11 2022] POST /identity/v3/projects => generated 357 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:11.935623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:12.030285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2232bcee-8741-4e99-b48d-cb8e8b6bcdc4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:12.049434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571febb8-271d-4622-bbcd-99e4b261a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:12.050648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571febb8-271d-4622-bbcd-99e4b261a6bb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:12.050935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571febb8-271d-4622-bbcd-99e4b261a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:12.051213 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571febb8-271d-4622-bbcd-99e4b261a6bb admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:12.053128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571febb8-271d-4622-bbcd-99e4b261a6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:12.057059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571febb8-271d-4622-bbcd-99e4b261a6bb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:12.067725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc23ddb520643108e381fb3cc57dc50', 'request_id': 'req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.077183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc23ddb520643108e381fb3cc57dc50', 'request_id': 'req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.159939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc23ddb520643108e381fb3cc57dc50', 'request_id': 'req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.166556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1030/2068] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:11 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:12.168471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:12.169067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:12.169562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:12.182603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] The token cache is being invalidate because project 9fc23ddb520643108e381fb3cc57dc50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:12.183343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.184252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.187343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1039/2069] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:11 2022] DELETE /identity/v3/projects/9fc23ddb520643108e381fb3cc57dc50 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:12.189086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:12.190980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:12.201622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:12.203807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:12.314864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8217e45-9b7a-4f3d-bd7b-8e55dc0cb0aa admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:12.322809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:12.323875 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:12.324369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:12.324749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:12.325725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:12.328076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:12.333587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1031/2070] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 18 06:26:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:12.335443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:12.339892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:12.357778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1040/2071] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:12.359874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:12.376238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce82652-a749-45df-84eb-972ccb196929 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:12.382129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:12.385305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:12.386340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:12.386693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:12.387028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] PATH_INFO: `/v3/projects/ebc502fb8e604a6aa82111faf2730d36/users/ab5cca4d1d964a0b94c2334b14342386/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:12.396151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132ed01-7f36-4bc0-a971-9a3370e36f27 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:12.406190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:12.409125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:12.409741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:12.410837 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] PATH_INFO: `/v3/users/cf04db197da347daba09e4aec36328ce` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:12.413302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf04db197da347daba09e4aec36328ce)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:12.418988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:12.430206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc502fb8e604a6aa82111faf2730d36, user_id=ab5cca4d1d964a0b94c2334b14342386, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:12.433503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:12.568920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1041/2072] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:12 2022] PUT /identity/v3/projects/ebc502fb8e604a6aa82111faf2730d36/users/ab5cca4d1d964a0b94c2334b14342386/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:12.569873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:12.578787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:12.794776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf04db197da347daba09e4aec36328ce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.820855 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11fce8-b701-461f-a631-4966c8a8ee3a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:12.827675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:12.828536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:12.829563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:12.830939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:12.948041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf04db197da347daba09e4aec36328ce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.949337 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf04db197da347daba09e4aec36328ce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.969416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:12.971814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:12.981244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf04db197da347daba09e4aec36328ce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.982871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5b02820c-9c2c-48d3-bb44-2893694886f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf04db197da347daba09e4aec36328ce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:12.997675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1042/2073] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:26:13.000365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:13.018859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1032/2074] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:12 2022] DELETE /identity/v3/users/cf04db197da347daba09e4aec36328ce => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:13.107471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:13.107471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:13.107471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:13.184476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] MFA Rules not processed for user `6b6c6957d1d54119bbb240a4bfda4b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:13.192058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:13.217428 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f9febc-c3d2-47a6-a452-6edd1b199101 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:13.385130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:13.386420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:13.386887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:13.387333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:13.388655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:13.392958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:13.423410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1033/2075] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:13.423621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1043/2076] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:13.423745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:13.425279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:13.431029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:13.433114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:13.452785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dd32d-6907-49ea-bef5-afafbb3c1456 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:13.477268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81eaae-2576-461a-941b-11220f00be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:13.478841 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81eaae-2576-461a-941b-11220f00be86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:13.479330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81eaae-2576-461a-941b-11220f00be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:13.479814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81eaae-2576-461a-941b-11220f00be86 admin admin] PATH_INFO: `/v3/projects/ebc502fb8e604a6aa82111faf2730d36/users/ab5cca4d1d964a0b94c2334b14342386/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:13.484061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81eaae-2576-461a-941b-11220f00be86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc502fb8e604a6aa82111faf2730d36, user_id=ab5cca4d1d964a0b94c2334b14342386, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:13.491881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81eaae-2576-461a-941b-11220f00be86 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:13.535775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1034/2077] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:13 2022] PUT /identity/v3/projects/ebc502fb8e604a6aa82111faf2730d36/users/ab5cca4d1d964a0b94c2334b14342386/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:13.552214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:13.552889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:13.554066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:13.632721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed93070-c3ad-4cae-af47-7d2cb56aec01 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:13.642941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] MFA Rules not processed for user `ab5cca4d1d964a0b94c2334b14342386`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:13.645151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:13.708817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:13.773192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:13.819713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:13.820409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:13.826165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:13.826800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:13.913033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1035/2078] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:13 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:13.933853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:13.936815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:14.043870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:14.049071 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dde4a-c760-4b84-8b74-adc308d035e9 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:14.051700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:14.054378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:14.055148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:14.055755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:14.056289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:14.072511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1044/2079] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:26:14.073851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:14.074261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:14.076588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:14.084149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:14.106692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1036/2080] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:14.267391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919f41a-c4de-48be-8f17-262c28d5e238 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:14.285018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:14.285018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:14.285018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:14.285018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] PATH_INFO: `/v3/projects/843ea97e5f9540bf8aae4363a320a215` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:14.285892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843ea97e5f9540bf8aae4363a320a215)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:14.290949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:14.342042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:14.445506 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:14.447968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:14.490160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d503c-937a-4a20-b227-d8ded30a4d7b service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:14.490414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843ea97e5f9540bf8aae4363a320a215', 'request_id': 'req-14a1afc4-0061-4fc2-ba01-a226680b2405'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:14.506204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843ea97e5f9540bf8aae4363a320a215', 'request_id': 'req-14a1afc4-0061-4fc2-ba01-a226680b2405'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:14.604594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9bf17-609f-4d68-b49b-6f8462696abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:14.605362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9bf17-609f-4d68-b49b-6f8462696abc service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:14.605654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9bf17-609f-4d68-b49b-6f8462696abc service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:14.606001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9bf17-609f-4d68-b49b-6f8462696abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:14.610873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3da9bf17-609f-4d68-b49b-6f8462696abc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:14.695442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843ea97e5f9540bf8aae4363a320a215', 'request_id': 'req-14a1afc4-0061-4fc2-ba01-a226680b2405'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:14.712264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] The token cache is being invalidate because project 843ea97e5f9540bf8aae4363a320a215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:14.713506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:14.713764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-14a1afc4-0061-4fc2-ba01-a226680b2405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:14.727878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1045/2081] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:14 2022] DELETE /identity/v3/projects/843ea97e5f9540bf8aae4363a320a215 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:14.728904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9bf17-609f-4d68-b49b-6f8462696abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:14.731256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9bf17-609f-4d68-b49b-6f8462696abc service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:14.735782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366807d6-9046-4869-b66e-9b0fc74099c2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:14.735990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366807d6-9046-4869-b66e-9b0fc74099c2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:14.736231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366807d6-9046-4869-b66e-9b0fc74099c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:14.751536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:14.766413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1037/2082] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:14.783071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-366807d6-9046-4869-b66e-9b0fc74099c2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:14.783858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-366807d6-9046-4869-b66e-9b0fc74099c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:14.868754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1046/2083] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:14.889563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e658-8236-43ce-9037-8bc65d709e85 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:14.890216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e658-8236-43ce-9037-8bc65d709e85 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:14.890638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61e658-8236-43ce-9037-8bc65d709e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:14.915847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8b61e658-8236-43ce-9037-8bc65d709e85 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:14.918724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8b61e658-8236-43ce-9037-8bc65d709e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:14.931053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1038/2084] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:14.941783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366807d6-9046-4869-b66e-9b0fc74099c2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:14.961132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366807d6-9046-4869-b66e-9b0fc74099c2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:14.982980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:14.983671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:14.984016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:14.984357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:14.988322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:14.989383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:14.991719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:15.017604 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1047/2085] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:26:15.024624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e658-8236-43ce-9037-8bc65d709e85 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:15.037491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61e658-8236-43ce-9037-8bc65d709e85 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:15.046527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:15.046527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:15.046527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:15.046527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:15.048177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:15.049781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:15.195191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:15.260246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1039/2086] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:15 2022] POST /identity/v3/projects => generated 377 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:15.265191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:15.287296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd6ddf3-9e6c-4526-838b-bd46e11e5c24 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:15.412102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:15.412264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:15.412953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:15.413341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:15.413922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:15.425425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:15.439847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:15.588126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1048/2087] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:15 2022] POST /identity/v3/users => generated 289 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:15.592522 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:15.611222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f169b8-a168-4710-9104-9b4e605d0c50 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:15.616956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:15.617740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:15.618031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:15.618370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:15.619148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:15.621153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:15.635718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1040/2088] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:26:15.643946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:15.676269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583d566-6307-404c-a837-d23f0b9fe345 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:15.685958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc1c8b-705c-4652-8a53-62fb974160d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:15.687314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1c8b-705c-4652-8a53-62fb974160d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:15.687898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1c8b-705c-4652-8a53-62fb974160d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:15.688433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1c8b-705c-4652-8a53-62fb974160d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:15.689959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1c8b-705c-4652-8a53-62fb974160d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:15.700551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1c8b-705c-4652-8a53-62fb974160d5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:15.730877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1049/2089] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:15.732808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:15.747999 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16569dd0-face-4660-8ec6-416b6a48f7b4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:15.756532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:15.758060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:15.758580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:15.759084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] PATH_INFO: `/v3/projects/79d5e0422f17486ba7d20d962c760b18/users/f884884f522a447a98d4bd8b7ce62532/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:15.827418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d5e0422f17486ba7d20d962c760b18, user_id=f884884f522a447a98d4bd8b7ce62532, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:15.828279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:15.906814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:15.971914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1041/2090] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:15 2022] PUT /identity/v3/projects/79d5e0422f17486ba7d20d962c760b18/users/f884884f522a447a98d4bd8b7ce62532/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:15.993703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc7be9-022c-4cba-8a09-477f8612dc6d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:15.994332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc7be9-022c-4cba-8a09-477f8612dc6d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:15.994776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc7be9-022c-4cba-8a09-477f8612dc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:16.056666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fbfc7be9-022c-4cba-8a09-477f8612dc6d None None] MFA Rules not processed for user `f884884f522a447a98d4bd8b7ce62532`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:16.060825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fbfc7be9-022c-4cba-8a09-477f8612dc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:16.304103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1050/2091] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:16.310530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:16.427659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e866da8-0753-4c47-beb8-6cc695430348 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:16.440107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:16.441279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:16.441763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:16.442231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:16.444879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:16.448159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:16.617365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1042/2092] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:16 2022] POST /identity/v3/projects => generated 375 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:16.622711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc7be9-022c-4cba-8a09-477f8612dc6d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:16.643405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfc7be9-022c-4cba-8a09-477f8612dc6d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:16.807291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:16.808099 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:16.809118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:16.809955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:16.818685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:16.820291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:16.825862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:16.965803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1051/2093] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:16 2022] POST /identity/v3/users => generated 288 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:16.970391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:16.983846 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcbe0f8-2e8d-44eb-b07c-c4f8fd3b3869 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:16.992169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:16.993425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:16.993890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:16.994310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:16.995239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:16.997288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:17.013118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1043/2094] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:17.017812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:17.033113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dd6a4c-a85e-4c7a-bbaa-9f59aefd6d4d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:17.039757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937186f0-3508-45c1-889a-cd2cae6acb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:17.040610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937186f0-3508-45c1-889a-cd2cae6acb33 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:17.041108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937186f0-3508-45c1-889a-cd2cae6acb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:17.041808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937186f0-3508-45c1-889a-cd2cae6acb33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:17.044058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937186f0-3508-45c1-889a-cd2cae6acb33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:17.046769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937186f0-3508-45c1-889a-cd2cae6acb33 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:17.069676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1052/2095] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:26:17.070718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:17.083967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e1590-ba3c-4d3a-ae90-ef7286006118 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:17.090027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:17.090946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:17.091230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:17.091674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] PATH_INFO: `/v3/projects/6275729c01804f11bbb5923cb6d61f16/users/deb86a3e274a4917abd683e1a07e0b10/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:17.113780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6275729c01804f11bbb5923cb6d61f16, user_id=deb86a3e274a4917abd683e1a07e0b10, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:17.117216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:17.221739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1044/2096] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:17 2022] PUT /identity/v3/projects/6275729c01804f11bbb5923cb6d61f16/users/deb86a3e274a4917abd683e1a07e0b10/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:17.234352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f292912-b1b6-4321-a775-7dc9aff51b55 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:17.237266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f292912-b1b6-4321-a775-7dc9aff51b55 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:17.238346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f292912-b1b6-4321-a775-7dc9aff51b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:17.306900 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5f292912-b1b6-4321-a775-7dc9aff51b55 None None] MFA Rules not processed for user `deb86a3e274a4917abd683e1a07e0b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:17.308763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5f292912-b1b6-4321-a775-7dc9aff51b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:17.498943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:17.504760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:17.569739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:17.583963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1053/2097] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:17.590061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f292912-b1b6-4321-a775-7dc9aff51b55 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:17.631727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3782b-ae54-49d1-a1f8-8be085363a33 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:17.650517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:17.651482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:17.651772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:17.652055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] PATH_INFO: `/v3/users/d36631c07b834bd88a63414cff557382` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:17.657980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d36631c07b834bd88a63414cff557382)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:17.663616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:17.758552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f292912-b1b6-4321-a775-7dc9aff51b55 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:17.778732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:17.780933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:17.785058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:17.785058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:17.785058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:17.786072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:17.932531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd36631c07b834bd88a63414cff557382'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:17.951666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1054/2098] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:17 2022] POST /identity/v3/projects => generated 375 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:17.951666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:17.955305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:18.079255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd36631c07b834bd88a63414cff557382'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.079705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd36631c07b834bd88a63414cff557382'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.108687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd36631c07b834bd88a63414cff557382'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.109599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd36631c07b834bd88a63414cff557382'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.136527 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:18.154527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1045/2099] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:17 2022] DELETE /identity/v3/users/d36631c07b834bd88a63414cff557382 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:18.159160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:18.163561 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:18.190511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a10cb66-1e5b-41dc-9f7b-44542712824d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:18.282829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2acddd9-7051-4229-af4f-4910dca7558d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:18.290227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d75752-8ca5-4f99-b7ef-76ac8b373afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:18.290227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75752-8ca5-4f99-b7ef-76ac8b373afc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:18.290227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75752-8ca5-4f99-b7ef-76ac8b373afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:18.290807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d75752-8ca5-4f99-b7ef-76ac8b373afc admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:18.291432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75752-8ca5-4f99-b7ef-76ac8b373afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:18.301105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d75752-8ca5-4f99-b7ef-76ac8b373afc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:18.341766 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:18.342772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:18.343134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:18.343511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] PATH_INFO: `/v3/users/b3bd17da8b404147bf3f2183e921c970` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:18.345113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3bd17da8b404147bf3f2183e921c970)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:18.347882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:18.408724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1046/2100] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:18 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:18.411845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5bd2-fc97-4a1c-9646-ca06f8b6dc61 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:18.412619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5bd2-fc97-4a1c-9646-ca06f8b6dc61 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:18.413350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea5bd2-fc97-4a1c-9646-ca06f8b6dc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:18.478924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b5ea5bd2-fc97-4a1c-9646-ca06f8b6dc61 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:18.480949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b5ea5bd2-fc97-4a1c-9646-ca06f8b6dc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:18.495831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1047/2101] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:18.497336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5bd2-fc97-4a1c-9646-ca06f8b6dc61 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:18.514040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea5bd2-fc97-4a1c-9646-ca06f8b6dc61 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:18.519777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:18.520368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:18.520649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:18.521143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:18.521912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:18.525762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:18.549285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1048/2102] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:18.551244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:18.557449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:18.659916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:18.672223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3bd17da8b404147bf3f2183e921c970'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.715492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3bd17da8b404147bf3f2183e921c970'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.759882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3bd17da8b404147bf3f2183e921c970'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.781351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f704dd-3fc6-441c-9b5a-6a3d7e1a1de2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:18.788916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:18.790090 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:18.790583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:18.791241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:18.812405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:18.816527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:18.838511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1049/2103] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:18.840248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:18.861789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ea1ec-bf08-4048-ad8f-7017813b6cef service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:18.871679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3838a5e-e6aa-4b50-b734-eea80fda8119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:18.873968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3838a5e-e6aa-4b50-b734-eea80fda8119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:18.874948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3838a5e-e6aa-4b50-b734-eea80fda8119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:18.876819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3838a5e-e6aa-4b50-b734-eea80fda8119 admin admin] PATH_INFO: `/v3/projects/184cd8a1302e491c80c6c6628b884710/users/24d5309d6f3a4659b4a13daf32de3055/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:18.911425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3bd17da8b404147bf3f2183e921c970'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.911705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b2f52cc4-c1c8-4d9d-81d0-402b35ed460c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3bd17da8b404147bf3f2183e921c970'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:18.931485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1055/2104] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:17 2022] DELETE /identity/v3/users/b3bd17da8b404147bf3f2183e921c970 => generated 0 bytes in 978 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:18.931790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3838a5e-e6aa-4b50-b734-eea80fda8119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184cd8a1302e491c80c6c6628b884710, user_id=24d5309d6f3a4659b4a13daf32de3055, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:18.934940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:18.935524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:18.936081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:18.937632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3838a5e-e6aa-4b50-b734-eea80fda8119 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:18.980586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:18.980586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:19.103125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1056/2105] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:19.117429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:19.121167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:19.149647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1050/2106] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:18 2022] PUT /identity/v3/projects/184cd8a1302e491c80c6c6628b884710/users/24d5309d6f3a4659b4a13daf32de3055/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:19.155302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:19.156098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:19.156796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:19.161970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:19.189872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] MFA Rules not processed for user `6b6c6957d1d54119bbb240a4bfda4b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:19.192799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:19.356178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545fb34-f73e-4d41-8e4a-aaf306d2c529 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:19.448937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1051/2107] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:19.448937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:19.448937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:19.495293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:19.497471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:19.498445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:19.499623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:19.563520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e803b626-6bb7-490e-a13f-36324e7fb55d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:19.572124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:19.573198 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:19.574440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:19.574440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:19.575748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:19.579926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:19.600684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1052/2108] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:19.606761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:19.622143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff0d94-621c-4582-8efc-5e876d39e39b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:19.643193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282059bf-e7f5-417f-81f4-7ec64edbf649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:19.644720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282059bf-e7f5-417f-81f4-7ec64edbf649 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:19.645335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282059bf-e7f5-417f-81f4-7ec64edbf649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:19.645801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282059bf-e7f5-417f-81f4-7ec64edbf649 admin admin] PATH_INFO: `/v3/projects/184cd8a1302e491c80c6c6628b884710/users/24d5309d6f3a4659b4a13daf32de3055/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:19.649992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282059bf-e7f5-417f-81f4-7ec64edbf649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=184cd8a1302e491c80c6c6628b884710, user_id=24d5309d6f3a4659b4a13daf32de3055, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:19.655054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282059bf-e7f5-417f-81f4-7ec64edbf649 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:19.686766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1053/2109] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:19 2022] PUT /identity/v3/projects/184cd8a1302e491c80c6c6628b884710/users/24d5309d6f3a4659b4a13daf32de3055/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:19.768012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:19.768012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:19.770682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:19.770682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:19.770682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:19.773051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1057/2110] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:19.775249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] MFA Rules not processed for user `24d5309d6f3a4659b4a13daf32de3055`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:19.777784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:19.981492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:19.988008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:20.042876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1054/2111] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:20.081317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28569c47-f319-46af-969c-03a2927ecbc0 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:20.246492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:20.247542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:20.247710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:20.248131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] PATH_INFO: `/v3/projects/4f801d5180bb40f8bd0b7a9ce5b3ac09` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:20.249763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f801d5180bb40f8bd0b7a9ce5b3ac09)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:20.260835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:20.371490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:20.373484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:20.442351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f636d9d4-c1fb-4da5-a133-f29bec6549aa None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:20.465137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:20.490624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f801d5180bb40f8bd0b7a9ce5b3ac09', 'request_id': 'req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:20.508868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f801d5180bb40f8bd0b7a9ce5b3ac09', 'request_id': 'req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:20.588488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f801d5180bb40f8bd0b7a9ce5b3ac09', 'request_id': 'req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:20.621394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] The token cache is being invalidate because project 4f801d5180bb40f8bd0b7a9ce5b3ac09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:20.625375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:20.625375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:20.634366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1058/2112] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:19 2022] DELETE /identity/v3/projects/4f801d5180bb40f8bd0b7a9ce5b3ac09 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:20.634366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:20.634366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:20.643499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:20.645165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:20.645505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:20.645963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] PATH_INFO: `/v3/projects/67c38853ef2447e18f5fd912efe5d72c` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:20.649393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c38853ef2447e18f5fd912efe5d72c)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:20.654454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:20.746748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe017bc-9891-4ccb-8c0d-e08a4f42ff3b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:20.751123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52e19b-c70f-4b44-b551-c4594ca1ef10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:20.751874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52e19b-c70f-4b44-b551-c4594ca1ef10 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:20.752267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52e19b-c70f-4b44-b551-c4594ca1ef10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:20.752416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52e19b-c70f-4b44-b551-c4594ca1ef10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:20.754526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-db52e19b-c70f-4b44-b551-c4594ca1ef10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:20.820622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:20.836538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c38853ef2447e18f5fd912efe5d72c', 'request_id': 'req-3ce2fe36-c7a9-484b-b155-37137156fd86'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:20.847674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c38853ef2447e18f5fd912efe5d72c', 'request_id': 'req-3ce2fe36-c7a9-484b-b155-37137156fd86'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:20.847837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52e19b-c70f-4b44-b551-c4594ca1ef10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:20.850188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52e19b-c70f-4b44-b551-c4594ca1ef10 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:20.868479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1059/2113] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:20.870606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1c96-8bfd-4563-a2e5-c1eb875d6382 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:20.871294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1c96-8bfd-4563-a2e5-c1eb875d6382 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:20.871785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1c96-8bfd-4563-a2e5-c1eb875d6382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:20.902460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-45cd1c96-8bfd-4563-a2e5-c1eb875d6382 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:20.906254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-45cd1c96-8bfd-4563-a2e5-c1eb875d6382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:20.980263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c38853ef2447e18f5fd912efe5d72c', 'request_id': 'req-3ce2fe36-c7a9-484b-b155-37137156fd86'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:21.028443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] The token cache is being invalidate because project 67c38853ef2447e18f5fd912efe5d72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:21.028757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:21.029678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ce2fe36-c7a9-484b-b155-37137156fd86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:21.036220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1055/2114] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:20 2022] DELETE /identity/v3/projects/67c38853ef2447e18f5fd912efe5d72c => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:21.043596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc231-1eed-4174-904c-1c174054da3b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.043892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc231-1eed-4174-904c-1c174054da3b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.044032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591cc231-1eed-4174-904c-1c174054da3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.073851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1060/2115] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:21.084875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-591cc231-1eed-4174-904c-1c174054da3b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:21.087097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00f76-bf45-4ebd-beb1-f884d98bc5e4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.087664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00f76-bf45-4ebd-beb1-f884d98bc5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.088038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e00f76-bf45-4ebd-beb1-f884d98bc5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.088424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-591cc231-1eed-4174-904c-1c174054da3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:21.105049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1056/2116] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:21.111524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f323a1-477e-4d8a-b377-c79d245e924e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.111851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f323a1-477e-4d8a-b377-c79d245e924e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.112085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f323a1-477e-4d8a-b377-c79d245e924e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.127582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-65e00f76-bf45-4ebd-beb1-f884d98bc5e4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:21.130042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-65e00f76-bf45-4ebd-beb1-f884d98bc5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:21.153767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1061/2117] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:21.155873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d1f323a1-477e-4d8a-b377-c79d245e924e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:21.156064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00f76-bf45-4ebd-beb1-f884d98bc5e4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.157395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d1f323a1-477e-4d8a-b377-c79d245e924e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:21.168451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e00f76-bf45-4ebd-beb1-f884d98bc5e4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.175343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.176026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.177524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.177924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.179128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:21.179745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.179880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1057/2118] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:21.182081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.185890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f323a1-477e-4d8a-b377-c79d245e924e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.200441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1062/2119] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:26:21.205380 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.207577 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f323a1-477e-4d8a-b377-c79d245e924e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.220927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.220927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.222442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.222866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63632aed-9eff-4203-baba-80301e9d3a30 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.223059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.224321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:21.224892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.227069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.228895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.229616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.229903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.230517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.231212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.233310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.255136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1058/2120] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:26:21.256901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.275601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc93be-7361-45fd-a2e5-83166c1cbe22 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.289117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.289117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.289117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.289117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.289739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.290989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.363422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1063/2121] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:21.365272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.390572 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:21.453241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea570e-8dff-4f44-8782-80de52e6641a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.459991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.460684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.460967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.461782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.462043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.464111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.479015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1059/2122] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:21.489027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.603548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03e8f5-8938-4f49-b0da-29c7df25baaa admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.634234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.634234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.634234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.634835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1064/2123] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:21.635106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.635259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.635403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.635403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.657816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04b078-0e52-4c8d-9731-09b7a20448af admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.665297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.666069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.666987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.667412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.668720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.671006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.684748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1065/2124] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:21.690017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.700230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a8142-0d52-466d-a3a5-1e48b87cfc7e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.709344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.710109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.716663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.716663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.716663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.716663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.728109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1066/2125] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:26:21.732830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.747003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31555b-4e8a-4f30-8ff6-a81e286f5b0d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.748386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1060/2126] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:21.753262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.758094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731d587-5ab6-4f63-b539-db4a4ad75cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.759002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d587-5ab6-4f63-b539-db4a4ad75cdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.759284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d587-5ab6-4f63-b539-db4a4ad75cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.759563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731d587-5ab6-4f63-b539-db4a4ad75cdf admin admin] PATH_INFO: `/v3/projects/b2b3d9219ab04740b6f8fc4f04823ee4/users/6669c2569b734bfab6a72ba92d69ee83/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.775342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f2b3-1b0c-4825-867c-529b41842a46 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.778753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731d587-5ab6-4f63-b539-db4a4ad75cdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2b3d9219ab04740b6f8fc4f04823ee4, user_id=6669c2569b734bfab6a72ba92d69ee83, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.782707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731d587-5ab6-4f63-b539-db4a4ad75cdf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.797325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.797325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.797325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.797325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.798393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.798393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.815641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1061/2127] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:26:21.821608 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.826899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:21.836371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceeb47e-6af8-4bdb-a4e2-bed50db9d57a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.841511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.842471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.842644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.842913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.843659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.845428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.858319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1062/2128] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:21.863656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:21.874225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e5da6-bb30-4a03-9e7c-61b110a16247 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:21.881087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f83ae8-7922-4574-8a8a-5fceb36dcc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:21.882010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83ae8-7922-4574-8a8a-5fceb36dcc0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.886980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83ae8-7922-4574-8a8a-5fceb36dcc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.886980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f83ae8-7922-4574-8a8a-5fceb36dcc0b admin admin] PATH_INFO: `/v3/projects/792c0de65583451a9989830333475276/users/24e68c42d0964540bbf78fbf2faf0ee0/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.900657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83ae8-7922-4574-8a8a-5fceb36dcc0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=792c0de65583451a9989830333475276, user_id=24e68c42d0964540bbf78fbf2faf0ee0, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:21.903396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f83ae8-7922-4574-8a8a-5fceb36dcc0b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:21.921921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1067/2129] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:21 2022] PUT /identity/v3/projects/b2b3d9219ab04740b6f8fc4f04823ee4/users/6669c2569b734bfab6a72ba92d69ee83/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:21.928450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:21.928739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:21.929534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:21.964506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] MFA Rules not processed for user `6669c2569b734bfab6a72ba92d69ee83`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:21.965883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:22.061382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1063/2130] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:21 2022] PUT /identity/v3/projects/792c0de65583451a9989830333475276/users/24e68c42d0964540bbf78fbf2faf0ee0/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:22.069586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:22.073578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:22.073578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:22.086591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1068/2131] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:22.111686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:22.111686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:22.112507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:22.112507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:22.241113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b87b8e-e924-4fad-a63c-9ec032c9fc25 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:22.286835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1064/2132] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:22.369261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:22.375500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:22.381148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:22.382090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:22.382494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:22.382944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:22.491193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:22.493891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:22.517616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1069/2133] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:26:22.529012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee78a1e-090a-49bf-8315-5472de88b3f7 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:22.542472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fb01e-401f-4175-9577-740850d5ec83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:22.543838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fb01e-401f-4175-9577-740850d5ec83 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:22.545296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fb01e-401f-4175-9577-740850d5ec83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:22.546148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fb01e-401f-4175-9577-740850d5ec83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:22.573124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fb01e-401f-4175-9577-740850d5ec83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:22.575157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fb01e-401f-4175-9577-740850d5ec83 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:22.579073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:22.588389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1065/2134] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:26:22.594094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777c38-37b9-4f40-9bc5-58dbd3b42293 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:22.599921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:22.600955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:22.601362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:22.601642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] PATH_INFO: `/v3/users/6669c2569b734bfab6a72ba92d69ee83` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:22.603165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6669c2569b734bfab6a72ba92d69ee83)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:22.605240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:22.885138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6669c2569b734bfab6a72ba92d69ee83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:22.909584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6669c2569b734bfab6a72ba92d69ee83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:22.923534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6669c2569b734bfab6a72ba92d69ee83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:23.056135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6669c2569b734bfab6a72ba92d69ee83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:23.057247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6669c2569b734bfab6a72ba92d69ee83'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:23.068035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1070/2135] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:22 2022] DELETE /identity/v3/users/6669c2569b734bfab6a72ba92d69ee83 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:23.075038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:23.075551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:23.075666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:23.105668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:23.106941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:23.202554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1066/2136] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:23.215838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:23.217361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:23.289378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948ed4d-8bf0-427b-a51c-5d831540b171 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:23.293479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:23.294279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:23.294614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:23.295045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:23.309360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:23.311694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:23.327899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1071/2137] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:23.385401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:23.707810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:23.769239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:23.771154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:23.902312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dca881b-ccd6-458d-9d48-c2031eff4a7d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:23.909296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204948c-0010-411e-b083-419f8c0e0ef0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:23.911523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204948c-0010-411e-b083-419f8c0e0ef0 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:23.911523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204948c-0010-411e-b083-419f8c0e0ef0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:23.911523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204948c-0010-411e-b083-419f8c0e0ef0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:23.913191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d204948c-0010-411e-b083-419f8c0e0ef0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:24.020119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204948c-0010-411e-b083-419f8c0e0ef0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:24.021563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204948c-0010-411e-b083-419f8c0e0ef0 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:24.032998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1067/2138] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:26:24.160074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:24.164851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:24.208632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554152b0-b6a8-4209-8c05-67c4deeb12da service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:24.209934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:24.210972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:24.211344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:24.211710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] PATH_INFO: `/v3/projects/b2b3d9219ab04740b6f8fc4f04823ee4` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:24.213506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2b3d9219ab04740b6f8fc4f04823ee4)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:24.216780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:24.369116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2b3d9219ab04740b6f8fc4f04823ee4', 'request_id': 'req-ce3cfff2-d155-468d-aa69-6f537e9c5739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:24.382264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2b3d9219ab04740b6f8fc4f04823ee4', 'request_id': 'req-ce3cfff2-d155-468d-aa69-6f537e9c5739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:24.457170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2b3d9219ab04740b6f8fc4f04823ee4', 'request_id': 'req-ce3cfff2-d155-468d-aa69-6f537e9c5739'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:24.486544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] The token cache is being invalidate because project b2b3d9219ab04740b6f8fc4f04823ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:24.487083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:24.488443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:24.502065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1072/2139] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:24 2022] DELETE /identity/v3/projects/b2b3d9219ab04740b6f8fc4f04823ee4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:24.626521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3d01-4b95-4ab5-92a2-346c7aa4af6b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:24.627272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3d01-4b95-4ab5-92a2-346c7aa4af6b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:24.627514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5a3d01-4b95-4ab5-92a2-346c7aa4af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:24.737544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ae5a3d01-4b95-4ab5-92a2-346c7aa4af6b None None] MFA Rules not processed for user `24e68c42d0964540bbf78fbf2faf0ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:24.745814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ae5a3d01-4b95-4ab5-92a2-346c7aa4af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:24.994291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:25.018804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1068/2140] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:25.269959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:25.272423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:25.354144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cfff2-d155-468d-aa69-6f537e9c5739 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:25.361225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:25.362079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:25.362469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:25.363771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:25.375629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:25.377280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:25.388740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1073/2141] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:25.696616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:26.701915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a3d01-4b95-4ab5-92a2-346c7aa4af6b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:26.724863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5a3d01-4b95-4ab5-92a2-346c7aa4af6b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:26.729484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371be8f4-779c-430e-b139-aedeec75aea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:26.731124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be8f4-779c-430e-b139-aedeec75aea4 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:26.732003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be8f4-779c-430e-b139-aedeec75aea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:26.732752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371be8f4-779c-430e-b139-aedeec75aea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:26.737734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-371be8f4-779c-430e-b139-aedeec75aea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:26.855716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371be8f4-779c-430e-b139-aedeec75aea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:26.867307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371be8f4-779c-430e-b139-aedeec75aea4 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:26.880882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1069/2142] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:26.890807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:26.894912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:27.020807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1315c67e-57c8-45a6-9c9f-b5c58cd42c39 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:27.030485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:27.032689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:27.033253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:27.033753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] PATH_INFO: `/v3/users/4298dc45dca74510ae9158ee7df457ab` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:27.036421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4298dc45dca74510ae9158ee7df457ab)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:27.040171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:27.218611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:27.293779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4298dc45dca74510ae9158ee7df457ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:27.324325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4298dc45dca74510ae9158ee7df457ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:27.339430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4298dc45dca74510ae9158ee7df457ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:27.445736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4298dc45dca74510ae9158ee7df457ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:27.446013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8e3345a6-42ec-48d8-8e57-a9c707de8859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4298dc45dca74510ae9158ee7df457ab'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:27.458606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1074/2143] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:26 2022] DELETE /identity/v3/users/4298dc45dca74510ae9158ee7df457ab => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:27.464124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:27.464542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:27.464900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:27.495606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:27.497942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:27.645440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1070/2144] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:27.652818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:27.652818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:27.652818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:27.662891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:27.667304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:27.697654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] MFA Rules not processed for user `24e68c42d0964540bbf78fbf2faf0ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:27.699906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:27.874533 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1075/2145] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:27.886001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8736be-eafe-49e6-ac21-2d105bac02bc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:27.894729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:27.896479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:27.896952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:27.897676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:27.918714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:27.923281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:27.949381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1071/2146] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:28.824556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:28.827583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:28.862088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5b3d-772b-4de0-a784-c1766c5303c5 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:28.884696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:28.884696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:28.884696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:28.884696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] PATH_INFO: `/v3/projects/656adb01d6f54792bc2e67e116432582` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:28.886554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=656adb01d6f54792bc2e67e116432582)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:28.889654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:28.927960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:29.039906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '656adb01d6f54792bc2e67e116432582', 'request_id': 'req-0539f90a-a58f-4c88-9af7-4de231ad5bbe'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.105254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '656adb01d6f54792bc2e67e116432582', 'request_id': 'req-0539f90a-a58f-4c88-9af7-4de231ad5bbe'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.205839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '656adb01d6f54792bc2e67e116432582', 'request_id': 'req-0539f90a-a58f-4c88-9af7-4de231ad5bbe'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.254498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] The token cache is being invalidate because project 656adb01d6f54792bc2e67e116432582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:29.257632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.263300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.276702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1076/2147] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:28 2022] DELETE /identity/v3/projects/656adb01d6f54792bc2e67e116432582 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:29.283101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:29.322038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d60be6e-430a-41d7-8a93-6f908715f887 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:29.333855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:29.467186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:29.468189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:29.468541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:29.469386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] PATH_INFO: `/v3/users/ab5cca4d1d964a0b94c2334b14342386` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:29.472000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5cca4d1d964a0b94c2334b14342386)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:29.474091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:29.748223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5cca4d1d964a0b94c2334b14342386'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.867697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5cca4d1d964a0b94c2334b14342386'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.868811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5cca4d1d964a0b94c2334b14342386'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.890578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5cca4d1d964a0b94c2334b14342386'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.891510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-56df472a-1225-4d40-9939-e2e1cdbbdc76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5cca4d1d964a0b94c2334b14342386'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:29.909138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1072/2148] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:29 2022] DELETE /identity/v3/users/ab5cca4d1d964a0b94c2334b14342386 => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:30.831648 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:30.833901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:30.864605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0539f90a-a58f-4c88-9af7-4de231ad5bbe admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:30.961112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:30.962499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:30.962991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:30.963465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] PATH_INFO: `/v3/projects/ebc502fb8e604a6aa82111faf2730d36` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:30.965783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc502fb8e604a6aa82111faf2730d36)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:30.969619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:31.163331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc502fb8e604a6aa82111faf2730d36', 'request_id': 'req-e32f89a8-eb80-455d-988a-8928fe481b01'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:31.171352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc502fb8e604a6aa82111faf2730d36', 'request_id': 'req-e32f89a8-eb80-455d-988a-8928fe481b01'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:31.278261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc502fb8e604a6aa82111faf2730d36', 'request_id': 'req-e32f89a8-eb80-455d-988a-8928fe481b01'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:31.291726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] The token cache is being invalidate because project ebc502fb8e604a6aa82111faf2730d36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:31.292027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:31.295105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e32f89a8-eb80-455d-988a-8928fe481b01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:31.297001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1077/2149] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:30 2022] DELETE /identity/v3/projects/ebc502fb8e604a6aa82111faf2730d36 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:31.304753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a76cd-3397-44ee-9171-17214b01f6ad None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:31.306502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a76cd-3397-44ee-9171-17214b01f6ad None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:31.307260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55a76cd-3397-44ee-9171-17214b01f6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:31.341563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d55a76cd-3397-44ee-9171-17214b01f6ad None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:31.343514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d55a76cd-3397-44ee-9171-17214b01f6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:31.469356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1073/2150] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:31.483016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07502c7-67d6-42cc-b15c-bf0ad4ba6e2a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:31.484320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07502c7-67d6-42cc-b15c-bf0ad4ba6e2a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:31.485471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07502c7-67d6-42cc-b15c-bf0ad4ba6e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:31.516713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f07502c7-67d6-42cc-b15c-bf0ad4ba6e2a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:31.518345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f07502c7-67d6-42cc-b15c-bf0ad4ba6e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:31.527669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1078/2151] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:31.534923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a76cd-3397-44ee-9171-17214b01f6ad None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:31.552278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55a76cd-3397-44ee-9171-17214b01f6ad None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:31.576397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:31.578011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:31.578647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:31.580301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:31.581799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:31.586707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:31.586707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:31.605923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1074/2152] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:26:31.615055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07502c7-67d6-42cc-b15c-bf0ad4ba6e2a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:31.634672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07502c7-67d6-42cc-b15c-bf0ad4ba6e2a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:31.640806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:31.640806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:31.643200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:31.643449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:31.644374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:31.647726 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:31.824001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1079/2153] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:31 2022] POST /identity/v3/projects => generated 369 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:31.830607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:31.849956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822680b-ec83-433a-a271-edc012d96eea admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:31.889448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:31.958581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:31.959467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:31.959660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:31.959952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:31.960806 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:31.963068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:32.113244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1075/2154] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:31 2022] POST /identity/v3/users => generated 285 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:32.115394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:32.133631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0bda9-60a3-42a4-9bd0-450f306c6ca9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:32.141833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:32.142859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:32.143318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:32.143759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:32.145134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:32.147565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:32.151600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:32.175325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1080/2155] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:32.176546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:32.197720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f68e7-2838-4d5a-b653-f06327e3dc63 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:32.206988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703baa0e-bd38-4d37-a274-ac50a9ba4ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:32.208329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703baa0e-bd38-4d37-a274-ac50a9ba4ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:32.209154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703baa0e-bd38-4d37-a274-ac50a9ba4ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:32.209648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703baa0e-bd38-4d37-a274-ac50a9ba4ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:32.211061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703baa0e-bd38-4d37-a274-ac50a9ba4ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:32.215400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703baa0e-bd38-4d37-a274-ac50a9ba4ba6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:32.246432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1076/2156] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:26:32.247562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:32.262569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6090-ef58-4815-85f3-9a7cdb569d38 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:32.273272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:32.274538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:32.274820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:32.275307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] PATH_INFO: `/v3/projects/829603fcf7e4487cb492a68efa73a849/users/e66a00a2d6fe4b7e98178a682f2965c4/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:32.298327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=829603fcf7e4487cb492a68efa73a849, user_id=e66a00a2d6fe4b7e98178a682f2965c4, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:32.302261 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:32.458302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1081/2157] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:32 2022] PUT /identity/v3/projects/829603fcf7e4487cb492a68efa73a849/users/e66a00a2d6fe4b7e98178a682f2965c4/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:32.479458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b345-4bf1-4a1a-9889-82db8e5fa536 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:32.480323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b345-4bf1-4a1a-9889-82db8e5fa536 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:32.480504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7b345-4bf1-4a1a-9889-82db8e5fa536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:32.533788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-aeb7b345-4bf1-4a1a-9889-82db8e5fa536 None None] MFA Rules not processed for user `e66a00a2d6fe4b7e98178a682f2965c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:32.537237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-aeb7b345-4bf1-4a1a-9889-82db8e5fa536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:32.621436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:32.624194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:32.672091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1077/2158] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 18 06:26:32.679516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7b345-4bf1-4a1a-9889-82db8e5fa536 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:32.765155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360981ad-d035-41e5-b4ad-9785b8346b48 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:32.772354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:32.773738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:32.773912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:32.774231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] PATH_INFO: `/v3/users/f884884f522a447a98d4bd8b7ce62532` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:32.776030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f884884f522a447a98d4bd8b7ce62532)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:32.778137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:32.843833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7b345-4bf1-4a1a-9889-82db8e5fa536 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:32.850068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:32.850798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:32.851191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:32.851471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:32.853124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:32.854200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:33.062384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1078/2159] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:32 2022] POST /identity/v3/projects => generated 369 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:33.069944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:33.128357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f884884f522a447a98d4bd8b7ce62532'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:33.179775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f884884f522a447a98d4bd8b7ce62532'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:33.208093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f884884f522a447a98d4bd8b7ce62532'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:33.245168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee1ab4-8dd3-4c2e-ac6f-5696347d7c74 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:33.256431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:33.260625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:33.260625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:33.260625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:33.261550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:33.265874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:33.288832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:33.313577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f884884f522a447a98d4bd8b7ce62532'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:33.314236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-af994cf4-de04-428c-89e6-19faf030fb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f884884f522a447a98d4bd8b7ce62532'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:33.327080 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1082/2160] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:32 2022] DELETE /identity/v3/users/f884884f522a447a98d4bd8b7ce62532 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:33.328961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:33.329278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:33.329743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:33.354989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:33.356273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:33.417569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1079/2161] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:33 2022] POST /identity/v3/users => generated 291 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:33.424875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:33.431120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:33.460961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1083/2162] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:33.462443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:33.475081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:33.487326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af15925-ad4a-4a88-8735-44b8e01efef9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:33.489408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:33.507327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:33.508050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:33.508386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:33.508665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:33.509607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:33.511249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:33.526995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1080/2163] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:33.530093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:33.548500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4eb755-76fe-4530-bff7-0192b786bdff admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:33.554653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:33.555576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:33.555859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:33.556136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] PATH_INFO: `/v3/projects/f525c653bc5d45459a81278bca6c8c69/users/a5fd2aadc492464685d40744c75ff9a3/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:33.598645 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f525c653bc5d45459a81278bca6c8c69, user_id=a5fd2aadc492464685d40744c75ff9a3, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:33.601440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:33.653517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139c771-5498-43e8-a860-00d3f574de4a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:33.666442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:33.666442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:33.666442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:33.666442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:33.678134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:33.679693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:33.695076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1084/2164] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:33.706054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1081/2165] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:33 2022] PUT /identity/v3/projects/f525c653bc5d45459a81278bca6c8c69/users/a5fd2aadc492464685d40744c75ff9a3/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:33.712250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:33.730598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd05533-ab82-43f0-a628-e6c007c295fb service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:33.884521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3425b93-a383-4004-8242-84f316bcd7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:33.885315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3425b93-a383-4004-8242-84f316bcd7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:33.885591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3425b93-a383-4004-8242-84f316bcd7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:33.885972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3425b93-a383-4004-8242-84f316bcd7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:33.886915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3425b93-a383-4004-8242-84f316bcd7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:33.888838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3425b93-a383-4004-8242-84f316bcd7a5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:33.904493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1085/2166] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:33.909142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:33.928394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447fef8-d27d-4fb2-bc91-2b37f112e2d6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:33.941861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:33.943514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:33.944023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:33.944534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] PATH_INFO: `/v3/projects/f525c653bc5d45459a81278bca6c8c69/users/a5fd2aadc492464685d40744c75ff9a3/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:33.948301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f525c653bc5d45459a81278bca6c8c69, user_id=a5fd2aadc492464685d40744c75ff9a3, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:33.953994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:33.974262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1082/2167] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:33 2022] PUT /identity/v3/projects/f525c653bc5d45459a81278bca6c8c69/users/a5fd2aadc492464685d40744c75ff9a3/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:34.001306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:34.001728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:34.001996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:34.064237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] MFA Rules not processed for user `a5fd2aadc492464685d40744c75ff9a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:34.067101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:34.202224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1086/2168] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:34.227655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:34.241443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:34.396842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5559a40-91b8-46f4-a24e-751b5d8c8853 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:34.407266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:34.409487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:34.409591 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:34.410356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:34.430701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:34.434082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:34.454620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1083/2169] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:34 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:34.673126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:34.676858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:34.686187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:34.689348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:34.701538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb0af4-5121-4c80-bbb9-6aa66db909ac None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:34.709368 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:34.711746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:34.712483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:34.713384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:34.718348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:34.890369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:34.894063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:34.918133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1087/2170] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:34.940030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:34.981865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1bbf4b-4104-4693-a450-c5b325735748 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:34.992937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:34.994515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:34.995245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:34.995795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] PATH_INFO: `/v3/projects/79d5e0422f17486ba7d20d962c760b18` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:35.005943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d5e0422f17486ba7d20d962c760b18)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:35.009465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:35.023011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:35.144306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d5e0422f17486ba7d20d962c760b18', 'request_id': 'req-4cccc816-923e-4df7-99a9-201e3687bbbd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.154759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d5e0422f17486ba7d20d962c760b18', 'request_id': 'req-4cccc816-923e-4df7-99a9-201e3687bbbd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.256297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d5e0422f17486ba7d20d962c760b18', 'request_id': 'req-4cccc816-923e-4df7-99a9-201e3687bbbd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.271736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] The token cache is being invalidate because project 79d5e0422f17486ba7d20d962c760b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:35.272118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.272891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.274826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1084/2171] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:34 2022] DELETE /identity/v3/projects/79d5e0422f17486ba7d20d962c760b18 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:35.279361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:35.297418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2d5855-01b6-407e-b5bb-cee48aafe333 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:35.406839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:35.407845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:35.408336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:35.408689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] PATH_INFO: `/v3/users/deb86a3e274a4917abd683e1a07e0b10` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:35.410360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=deb86a3e274a4917abd683e1a07e0b10)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:35.413111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:35.772629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'deb86a3e274a4917abd683e1a07e0b10'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.800409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'deb86a3e274a4917abd683e1a07e0b10'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.817603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'deb86a3e274a4917abd683e1a07e0b10'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.972307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'deb86a3e274a4917abd683e1a07e0b10'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:35.973481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'deb86a3e274a4917abd683e1a07e0b10'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:36.007465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1088/2172] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:35 2022] DELETE /identity/v3/users/deb86a3e274a4917abd683e1a07e0b10 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:36.960073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:36.962180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:36.990537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cccc816-923e-4df7-99a9-201e3687bbbd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:37.179133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:37.181633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:37.182186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:37.182638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] PATH_INFO: `/v3/projects/6275729c01804f11bbb5923cb6d61f16` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:37.186000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6275729c01804f11bbb5923cb6d61f16)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:37.196049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:37.369350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6275729c01804f11bbb5923cb6d61f16', 'request_id': 'req-39428db8-4ba4-498b-8222-ad73861d8989'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:37.380951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6275729c01804f11bbb5923cb6d61f16', 'request_id': 'req-39428db8-4ba4-498b-8222-ad73861d8989'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:37.548257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6275729c01804f11bbb5923cb6d61f16', 'request_id': 'req-39428db8-4ba4-498b-8222-ad73861d8989'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:37.567471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] The token cache is being invalidate because project 6275729c01804f11bbb5923cb6d61f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:37.567963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:37.568947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:37.573008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1085/2173] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:36 2022] DELETE /identity/v3/projects/6275729c01804f11bbb5923cb6d61f16 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:37.579812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:37.585719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:37.620381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be34b2d9-ed1f-47db-9a6d-431863981d51 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:37.708898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:37.775196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:37.777098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:37.778105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:37.778650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] PATH_INFO: `/v3/users/24d5309d6f3a4659b4a13daf32de3055` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:37.783035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24d5309d6f3a4659b4a13daf32de3055)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:37.792300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:38.056367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24d5309d6f3a4659b4a13daf32de3055'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:38.088874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24d5309d6f3a4659b4a13daf32de3055'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:38.130613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24d5309d6f3a4659b4a13daf32de3055'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:38.240734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24d5309d6f3a4659b4a13daf32de3055'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:38.241307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d6b0fa2-ab0e-445f-b7bd-f6ce07526377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24d5309d6f3a4659b4a13daf32de3055'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:38.268365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1089/2174] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:37 2022] DELETE /identity/v3/users/24d5309d6f3a4659b4a13daf32de3055 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:39.261272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:39.263354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:39.293279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39428db8-4ba4-498b-8222-ad73861d8989 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:39.358421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:39.446694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:39.448357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:39.448881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:39.450958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] PATH_INFO: `/v3/projects/184cd8a1302e491c80c6c6628b884710` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:39.454524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=184cd8a1302e491c80c6c6628b884710)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:39.458450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:39.651537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184cd8a1302e491c80c6c6628b884710', 'request_id': 'req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:39.661528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184cd8a1302e491c80c6c6628b884710', 'request_id': 'req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:39.770664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184cd8a1302e491c80c6c6628b884710', 'request_id': 'req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:39.795371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] The token cache is being invalidate because project 184cd8a1302e491c80c6c6628b884710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:39.795911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:39.798534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a19fafce-1c4f-4224-a331-7cbe9d3a8fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:39.800926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1086/2175] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:39 2022] DELETE /identity/v3/projects/184cd8a1302e491c80c6c6628b884710 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:39.810606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684e6d-351a-422c-9c3a-a9053a12c05a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:39.811153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684e6d-351a-422c-9c3a-a9053a12c05a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:39.811514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9684e6d-351a-422c-9c3a-a9053a12c05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:39.842716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b9684e6d-351a-422c-9c3a-a9053a12c05a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:39.844891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b9684e6d-351a-422c-9c3a-a9053a12c05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:39.940550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1090/2176] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:40.047672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36976f1-c030-486a-b712-7a985205d6b6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.048764 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36976f1-c030-486a-b712-7a985205d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.049413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36976f1-c030-486a-b712-7a985205d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.087582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b36976f1-c030-486a-b712-7a985205d6b6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:40.090208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b36976f1-c030-486a-b712-7a985205d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:40.114101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1087/2177] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:40.116787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684e6d-351a-422c-9c3a-a9053a12c05a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:40.138100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9684e6d-351a-422c-9c3a-a9053a12c05a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:40.152285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:40.153605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.154055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.154508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.157461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:40.158101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:40.160107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:40.178864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1091/2178] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:26:40.185590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36976f1-c030-486a-b712-7a985205d6b6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:40.210452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36976f1-c030-486a-b712-7a985205d6b6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:40.221533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb84b15-7d0e-4a87-b0c5-11aedd102f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:40.222798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb84b15-7d0e-4a87-b0c5-11aedd102f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.223351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb84b15-7d0e-4a87-b0c5-11aedd102f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.223921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb84b15-7d0e-4a87-b0c5-11aedd102f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.225450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb84b15-7d0e-4a87-b0c5-11aedd102f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:40.229142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb84b15-7d0e-4a87-b0c5-11aedd102f12 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:40.378925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1088/2179] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:40 2022] POST /identity/v3/projects => generated 371 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:40.385028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:40.423429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99842d78-ee7f-4d02-81bf-e09ea8065532 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:40.522882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:40.548669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:40.549701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.550306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.550727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.551618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:40.554355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:40.575571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4806-d52a-400d-8e7b-fe47b2a92cce None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.576168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4806-d52a-400d-8e7b-fe47b2a92cce None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.576687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b4806-d52a-400d-8e7b-fe47b2a92cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.612346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0a4b4806-d52a-400d-8e7b-fe47b2a92cce None None] MFA Rules not processed for user `4b57f9679e65450b9d97b0ce893fd6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:40.614669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0a4b4806-d52a-400d-8e7b-fe47b2a92cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:40.717783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1092/2180] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:40 2022] POST /identity/v3/users => generated 286 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:40.720152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:40.742935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1089/2181] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:40.748157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79513-0845-4adf-8e67-886a858c23a3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:40.754577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:40.755363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.755756 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.756218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.758217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:40.760292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:40.779788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1093/2182] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:40.785420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b4806-d52a-400d-8e7b-fe47b2a92cce None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:40.803560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b4806-d52a-400d-8e7b-fe47b2a92cce None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:40.809442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d66ee-6063-4b09-aa8d-08e4071427a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:40.810140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d66ee-6063-4b09-aa8d-08e4071427a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.810617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d66ee-6063-4b09-aa8d-08e4071427a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.810906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d66ee-6063-4b09-aa8d-08e4071427a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.811661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d66ee-6063-4b09-aa8d-08e4071427a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:40.814044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d66ee-6063-4b09-aa8d-08e4071427a9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:40.855628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1090/2183] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:40.860392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:40.882335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ecdc6-6522-4471-963d-946dcbaf8d26 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:40.888373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:40.889551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:40.889845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:40.890132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] PATH_INFO: `/v3/projects/eba4ff8128484505ac67e970ef4ca00d/users/a941e179adb548d786bea92dc4a4db6e/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:40.911120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eba4ff8128484505ac67e970ef4ca00d, user_id=a941e179adb548d786bea92dc4a4db6e, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:40.914752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:41.026551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1094/2184] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:40 2022] PUT /identity/v3/projects/eba4ff8128484505ac67e970ef4ca00d/users/a941e179adb548d786bea92dc4a4db6e/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:41.038929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:41.039442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:41.039924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:41.077923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:41.150425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] MFA Rules not processed for user `a941e179adb548d786bea92dc4a4db6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:41.151605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:41.322516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1091/2185] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:41.334321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:41.335120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:41.437163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aeeb95-24b5-4fcb-bd97-96f712b629d2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:41.444929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a59e1-5b1a-4ec2-b4bc-a9b9d7afff9f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:41.446446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a59e1-5b1a-4ec2-b4bc-a9b9d7afff9f service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:41.446446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a59e1-5b1a-4ec2-b4bc-a9b9d7afff9f service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:41.446446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a59e1-5b1a-4ec2-b4bc-a9b9d7afff9f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:41.460021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a59e1-5b1a-4ec2-b4bc-a9b9d7afff9f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:41.462283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a59e1-5b1a-4ec2-b4bc-a9b9d7afff9f service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:41.488407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1095/2186] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:42.333759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:42.333759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:42.482256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f914e42-1a7c-46a0-bd8b-5b8310581b26 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:42.492246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:42.494466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:42.494789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:42.495563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] PATH_INFO: `/v3/users/e66a00a2d6fe4b7e98178a682f2965c4` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:42.499278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66a00a2d6fe4b7e98178a682f2965c4)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:42.503032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:42.870882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66a00a2d6fe4b7e98178a682f2965c4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:42.998601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66a00a2d6fe4b7e98178a682f2965c4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:42.999540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66a00a2d6fe4b7e98178a682f2965c4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:43.023017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66a00a2d6fe4b7e98178a682f2965c4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:43.025967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66a00a2d6fe4b7e98178a682f2965c4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:43.047231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1092/2187] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:42 2022] DELETE /identity/v3/users/e66a00a2d6fe4b7e98178a682f2965c4 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:43.052225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:43.052933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:43.053608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:43.085925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:43.088289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:43.184355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1096/2188] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:43.196392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:43.198286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:43.279921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d327b33-f10e-4b1a-bc7c-112ec49d7422 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:43.285051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:43.285737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:43.286047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:43.286328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:43.318553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:43.319440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:43.357126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1093/2189] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:43.533204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:44.275568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:44.277800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:44.313583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae7a2-cf33-4efa-99cb-0d6288e5736e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:44.319504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:44.320760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:44.321083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:44.321370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] PATH_INFO: `/v3/projects/829603fcf7e4487cb492a68efa73a849` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:44.326747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=829603fcf7e4487cb492a68efa73a849)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:44.335963 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:44.530125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:44.556088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '829603fcf7e4487cb492a68efa73a849', 'request_id': 'req-8c431c7b-5a8b-4eb8-b274-98ad185fd743'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:44.572409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '829603fcf7e4487cb492a68efa73a849', 'request_id': 'req-8c431c7b-5a8b-4eb8-b274-98ad185fd743'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:44.702329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '829603fcf7e4487cb492a68efa73a849', 'request_id': 'req-8c431c7b-5a8b-4eb8-b274-98ad185fd743'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:44.732842 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] The token cache is being invalidate because project 829603fcf7e4487cb492a68efa73a849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:44.733622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:44.734610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:44.745427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1097/2190] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:44 2022] DELETE /identity/v3/projects/829603fcf7e4487cb492a68efa73a849 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:44.745576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:44.755881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a338d5-5746-426f-9801-89ca0685e332 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:44.869974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:44.871017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:44.871331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:44.871638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] PATH_INFO: `/v3/users/a5fd2aadc492464685d40744c75ff9a3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:44.873376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fd2aadc492464685d40744c75ff9a3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:44.875853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:45.181369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fd2aadc492464685d40744c75ff9a3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:45.284307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fd2aadc492464685d40744c75ff9a3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:45.285714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fd2aadc492464685d40744c75ff9a3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:45.334816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fd2aadc492464685d40744c75ff9a3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:45.336551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-0ece26ad-c3e9-42c4-af1f-0120f2e4991c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fd2aadc492464685d40744c75ff9a3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:45.368788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1094/2191] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:44 2022] DELETE /identity/v3/users/a5fd2aadc492464685d40744c75ff9a3 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:46.679224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:46.681860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:46.705822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c431c7b-5a8b-4eb8-b274-98ad185fd743 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:46.799332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:46.809898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:46.810197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:46.810487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] PATH_INFO: `/v3/projects/f525c653bc5d45459a81278bca6c8c69` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:46.812234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f525c653bc5d45459a81278bca6c8c69)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:46.816626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:47.005178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f525c653bc5d45459a81278bca6c8c69', 'request_id': 'req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:47.035250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f525c653bc5d45459a81278bca6c8c69', 'request_id': 'req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:47.118221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f525c653bc5d45459a81278bca6c8c69', 'request_id': 'req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:47.150491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] The token cache is being invalidate because project f525c653bc5d45459a81278bca6c8c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:47.151001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:47.152087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3182cb3b-7b12-4a06-bdfe-6e9de64112e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:47.154645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1098/2192] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:46 2022] DELETE /identity/v3/projects/f525c653bc5d45459a81278bca6c8c69 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:47.162815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec40f-7068-41ca-a1c2-095ab9bcf191 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:47.163594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec40f-7068-41ca-a1c2-095ab9bcf191 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:47.163594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ec40f-7068-41ca-a1c2-095ab9bcf191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:47.187145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dc6ec40f-7068-41ca-a1c2-095ab9bcf191 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:47.188816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc6ec40f-7068-41ca-a1c2-095ab9bcf191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:47.232434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:47.285057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1095/2193] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:47.294040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa29ac-682c-4a04-8d16-02791fadee82 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:47.294865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa29ac-682c-4a04-8d16-02791fadee82 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:47.295998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa29ac-682c-4a04-8d16-02791fadee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:47.352880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ebaa29ac-682c-4a04-8d16-02791fadee82 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:47.355362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ebaa29ac-682c-4a04-8d16-02791fadee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:47.389620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1099/2194] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:26:47.391267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec40f-7068-41ca-a1c2-095ab9bcf191 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:47.415440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ec40f-7068-41ca-a1c2-095ab9bcf191 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:47.454852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:47.455960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:47.456535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:47.457075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:47.461283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:26:47.462145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:47.468318 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:47.507241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1096/2195] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:26:47.516565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa29ac-682c-4a04-8d16-02791fadee82 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:47.527939 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa29ac-682c-4a04-8d16-02791fadee82 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:47.534651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:47.549585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:47.549585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:47.549585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:47.549585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:47.549585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:47.727534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1100/2196] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:47 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:47.733159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:47.759918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdeba7-2918-47a8-99e2-e70bccc58bf0 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:47.861520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:47.870905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:47.870905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:47.870905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:47.870905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:47.870905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:47.960306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1097/2197] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:47 2022] POST /identity/v3/users => generated 289 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:47.965818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:47.979995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24723757-3b9c-4340-b22c-e6365a9b06ff admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:47.987003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:47.988123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:47.988504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:47.988893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:47.990277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:47.993185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:48.006733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1101/2198] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:48.012570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:48.024810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff427e-e16a-41ca-827a-286d08cf596a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:48.029865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488dad8d-18c1-4954-b976-6f19d0330f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:48.030629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dad8d-18c1-4954-b976-6f19d0330f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:48.030957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dad8d-18c1-4954-b976-6f19d0330f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:48.031657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488dad8d-18c1-4954-b976-6f19d0330f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:48.032446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dad8d-18c1-4954-b976-6f19d0330f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:48.034222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488dad8d-18c1-4954-b976-6f19d0330f0f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:48.047676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1098/2199] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:48.058156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:48.071876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763e59-096c-4bea-ad1b-2ac074659a2b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:48.079934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:48.081595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:48.082087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:48.082569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] PATH_INFO: `/v3/projects/92463970366b40628dc2d168a9b16f0e/users/132b986ee860427c94bbc3f3a80e57a5/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:48.103815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:48.111290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=92463970366b40628dc2d168a9b16f0e, user_id=132b986ee860427c94bbc3f3a80e57a5, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:48.116456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:48.209990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1102/2200] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:48 2022] PUT /identity/v3/projects/92463970366b40628dc2d168a9b16f0e/users/132b986ee860427c94bbc3f3a80e57a5/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:48.232851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f587b5-d3f4-4f16-9485-d35cbf51c348 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:48.233709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f587b5-d3f4-4f16-9485-d35cbf51c348 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:48.233709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f587b5-d3f4-4f16-9485-d35cbf51c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:48.282625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b0f587b5-d3f4-4f16-9485-d35cbf51c348 None None] MFA Rules not processed for user `132b986ee860427c94bbc3f3a80e57a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:48.284030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b0f587b5-d3f4-4f16-9485-d35cbf51c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:48.397093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1099/2201] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:48.404782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:48.518622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4193b-7fcb-41a0-9d55-f59aee250f6a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:48.524296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:48.525145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:48.525436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:48.525716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:48.526438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:48.528469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:48.619154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1103/2202] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:48 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:48.625964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f587b5-d3f4-4f16-9485-d35cbf51c348 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:48.645924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f587b5-d3f4-4f16-9485-d35cbf51c348 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:48.706776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:48.767352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:48.768601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:48.768757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:48.769348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:48.770570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:48.775145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:48.982951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1100/2203] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:48 2022] POST /identity/v3/users => generated 290 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:48.988419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:49.012100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69a9e0-2995-4091-b16f-1ea171dfd7fb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:49.031761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:49.031761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:49.031761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:49.031761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:49.032377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:49.033899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:49.052402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1104/2204] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:49.054454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:49.074494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fee1120-356c-40ea-a061-336ee1cd4e0b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:49.083918 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9aada-3071-4540-b4a4-ae0ab74ffe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:49.085215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9aada-3071-4540-b4a4-ae0ab74ffe66 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:49.085726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9aada-3071-4540-b4a4-ae0ab74ffe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:49.086238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9aada-3071-4540-b4a4-ae0ab74ffe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:49.087682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9aada-3071-4540-b4a4-ae0ab74ffe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:49.091103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9aada-3071-4540-b4a4-ae0ab74ffe66 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:49.123449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1101/2205] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:49.130163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:49.141707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403fcd5-ffcf-4561-94e7-6967f91bd623 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:49.148594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:49.149550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:49.149864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:49.150246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] PATH_INFO: `/v3/projects/9eccf619f73c41a5a8085264a7433914/users/840ba09efd874ac8a081236a45e80e06/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:49.178555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eccf619f73c41a5a8085264a7433914, user_id=840ba09efd874ac8a081236a45e80e06, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:49.178555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:49.293022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1105/2206] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:49 2022] PUT /identity/v3/projects/9eccf619f73c41a5a8085264a7433914/users/840ba09efd874ac8a081236a45e80e06/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:49.309802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bda6f-812c-4918-b338-560d3c41629d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:49.314293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bda6f-812c-4918-b338-560d3c41629d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:49.314744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bda6f-812c-4918-b338-560d3c41629d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:49.355088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-de9bda6f-812c-4918-b338-560d3c41629d None None] MFA Rules not processed for user `840ba09efd874ac8a081236a45e80e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:49.360956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-de9bda6f-812c-4918-b338-560d3c41629d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:49.527023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1102/2207] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:49.539161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:49.629792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19725cf-bac2-4241-9fc1-ff4b3dee6da3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:49.635413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:49.640364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:49.640364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:49.640364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:49.640364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:49.640364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:49.754717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1106/2208] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:26:49 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:26:49.755977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bda6f-812c-4918-b338-560d3c41629d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:49.777362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bda6f-812c-4918-b338-560d3c41629d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:49.864442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:49.865237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:49.865562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:49.865927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:49.866693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:49.868744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:50.012411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1103/2209] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:26:49 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:26:50.012577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:50.024055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0033aaf5-510e-490f-87ea-268fbd740914 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:50.030571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:50.031869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:50.032512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:50.032512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:50.033370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:50.036103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:50.055547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1107/2210] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:50.059410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:50.074858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bb9283-d53c-40de-a221-29366f37f506 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:50.087674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:50.088939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:50.089469 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:50.089968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] PATH_INFO: `/v3/projects/b300090b268d4745a7380cf32b7c3f95/users/6a65a201176d43dbb3e03045281868d2/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:50.128859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b300090b268d4745a7380cf32b7c3f95, user_id=6a65a201176d43dbb3e03045281868d2, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:50.131869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:50.234767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1104/2211] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:50 2022] PUT /identity/v3/projects/b300090b268d4745a7380cf32b7c3f95/users/6a65a201176d43dbb3e03045281868d2/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:50.240433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:50.253599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c7da9-5622-486d-a98d-16e2609ff9ae admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:50.264761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:50.429650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a40d9-0fca-48a0-af42-d3d9b167d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:50.438243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a40d9-0fca-48a0-af42-d3d9b167d218 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:50.438551 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a40d9-0fca-48a0-af42-d3d9b167d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:50.438953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a40d9-0fca-48a0-af42-d3d9b167d218 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:50.439897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a40d9-0fca-48a0-af42-d3d9b167d218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:50.442018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a40d9-0fca-48a0-af42-d3d9b167d218 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:50.465918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1108/2212] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:26:50.470013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:50.489536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f7e30-d7aa-4740-99d0-6f0fa02d14f3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:50.500929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:50.502840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:50.503403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:50.503505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] PATH_INFO: `/v3/projects/b300090b268d4745a7380cf32b7c3f95/users/6a65a201176d43dbb3e03045281868d2/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:50.506862 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b300090b268d4745a7380cf32b7c3f95, user_id=6a65a201176d43dbb3e03045281868d2, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:50.509977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:50.513223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:50.538856 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1105/2213] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:26:50 2022] PUT /identity/v3/projects/b300090b268d4745a7380cf32b7c3f95/users/6a65a201176d43dbb3e03045281868d2/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:50.552667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c8f6-950a-473c-909e-030e5025d69d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:50.553331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c8f6-950a-473c-909e-030e5025d69d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:50.553618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6c8f6-950a-473c-909e-030e5025d69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:50.599596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0bb6c8f6-950a-473c-909e-030e5025d69d None None] MFA Rules not processed for user `6a65a201176d43dbb3e03045281868d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:50.601688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0bb6c8f6-950a-473c-909e-030e5025d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:50.752493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1109/2214] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:50 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:50.764676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:50.767084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:50.848334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119bf8-9fd2-4601-b9da-11eb110d597a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:50.852529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33cf4d6-09a0-40aa-9a75-26638565b50e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:50.853229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf4d6-09a0-40aa-9a75-26638565b50e service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:50.853783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf4d6-09a0-40aa-9a75-26638565b50e service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:50.854003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33cf4d6-09a0-40aa-9a75-26638565b50e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:50.867229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf4d6-09a0-40aa-9a75-26638565b50e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:50.868770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33cf4d6-09a0-40aa-9a75-26638565b50e service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:50.883257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1106/2215] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:26:51.106724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6c8f6-950a-473c-909e-030e5025d69d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:51.119131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6c8f6-950a-473c-909e-030e5025d69d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:51.122662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:51.123319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:51.123606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:51.123877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:51.191561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:51.193188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:51.204117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1110/2216] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:26:55.816373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e805-337a-4230-a235-a86f7e04855a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:55.817860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e805-337a-4230-a235-a86f7e04855a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:55.818595 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9e805-337a-4230-a235-a86f7e04855a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:55.862588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-eed9e805-337a-4230-a235-a86f7e04855a None None] MFA Rules not processed for user `1c4e450af95547bc9c633612b110858e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:55.866831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-eed9e805-337a-4230-a235-a86f7e04855a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:55.957249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1107/2217] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:56.049510 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:56.114607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:56.154708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a07b3a-54e9-4dca-a107-5f9e3113c2d4 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:56.160293 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:56.161231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:56.161514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:56.161833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] PATH_INFO: `/v3/users/132b986ee860427c94bbc3f3a80e57a5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:56.163171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132b986ee860427c94bbc3f3a80e57a5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:56.165264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:56.393246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132b986ee860427c94bbc3f3a80e57a5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:56.417890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132b986ee860427c94bbc3f3a80e57a5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:56.425177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132b986ee860427c94bbc3f3a80e57a5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:56.495073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132b986ee860427c94bbc3f3a80e57a5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:56.498585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132b986ee860427c94bbc3f3a80e57a5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:56.503446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1111/2218] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:56 2022] DELETE /identity/v3/users/132b986ee860427c94bbc3f3a80e57a5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:56.511301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:56.511797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:56.512266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:56.542155 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:26:56.543607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:56.654016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1108/2219] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:26:56.668118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:56.669622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:56.737638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710c481-d554-4a88-b1f7-26a154cee354 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:56.741856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:56.742656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:56.742935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:56.743234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:56.754323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:56.755808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:56.768850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1112/2220] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:26:57.350619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:57.359959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:57.378306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a73115-025b-4795-b5a5-39f7998bce1a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:57.385747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:57.386815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:57.388081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:57.388081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] PATH_INFO: `/v3/projects/92463970366b40628dc2d168a9b16f0e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:57.389475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92463970366b40628dc2d168a9b16f0e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:57.392586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:57.535114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:57.542895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92463970366b40628dc2d168a9b16f0e', 'request_id': 'req-7bfd78cf-397b-45f9-b025-5021f2b72775'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:57.555279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92463970366b40628dc2d168a9b16f0e', 'request_id': 'req-7bfd78cf-397b-45f9-b025-5021f2b72775'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:57.632442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92463970366b40628dc2d168a9b16f0e', 'request_id': 'req-7bfd78cf-397b-45f9-b025-5021f2b72775'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:57.645696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] The token cache is being invalidate because project 92463970366b40628dc2d168a9b16f0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:57.646074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:57.646863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:57.648912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1109/2221] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:57 2022] DELETE /identity/v3/projects/92463970366b40628dc2d168a9b16f0e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:57.653274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:57.664708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b380a-08c1-4abe-bdf8-31deeb5be478 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:57.726317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:57.733802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:57.735321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:57.735609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:57.735897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] PATH_INFO: `/v3/users/840ba09efd874ac8a081236a45e80e06` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:57.737271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] RBAC: Authorizing `identity:delete_user(user_id=840ba09efd874ac8a081236a45e80e06)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:57.739269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:58.003136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '840ba09efd874ac8a081236a45e80e06'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:58.016573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '840ba09efd874ac8a081236a45e80e06'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:58.024539 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '840ba09efd874ac8a081236a45e80e06'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:58.118146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '840ba09efd874ac8a081236a45e80e06'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:58.118928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '840ba09efd874ac8a081236a45e80e06'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:58.127787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1113/2222] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:57 2022] DELETE /identity/v3/users/840ba09efd874ac8a081236a45e80e06 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:26:58.665901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:58.667480 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:58.682894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd78cf-397b-45f9-b025-5021f2b72775 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:58.778381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:58.779342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:58.779730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:58.780011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] PATH_INFO: `/v3/projects/9eccf619f73c41a5a8085264a7433914` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:58.781442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eccf619f73c41a5a8085264a7433914)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:58.786592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:58.909238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eccf619f73c41a5a8085264a7433914', 'request_id': 'req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:58.925748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eccf619f73c41a5a8085264a7433914', 'request_id': 'req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.014931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eccf619f73c41a5a8085264a7433914', 'request_id': 'req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.028509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] The token cache is being invalidate because project 9eccf619f73c41a5a8085264a7433914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:26:59.029071 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.029742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.031715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1110/2223] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:26:58 2022] DELETE /identity/v3/projects/9eccf619f73c41a5a8085264a7433914 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:26:59.036091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:26:59.037628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:26:59.052163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb17373-832a-4dc8-96ea-b9aa4c5ad34b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:26:59.122209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:26:59.123113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:26:59.123405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:26:59.123688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] PATH_INFO: `/v3/users/6a65a201176d43dbb3e03045281868d2` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:26:59.125881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a65a201176d43dbb3e03045281868d2)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:26:59.127784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:26:59.446607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a65a201176d43dbb3e03045281868d2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.460365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a65a201176d43dbb3e03045281868d2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.467455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a65a201176d43dbb3e03045281868d2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.470697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:26:59.603937 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a65a201176d43dbb3e03045281868d2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.604591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-c087b487-91c3-40ca-8fb1-05c2f781ddcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a65a201176d43dbb3e03045281868d2'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:26:59.614316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1114/2224] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:26:59 2022] DELETE /identity/v3/users/6a65a201176d43dbb3e03045281868d2 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:00.361972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:00.365742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:00.385208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5875d-ab3d-4af5-9eb0-f25d72226d9d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:00.494730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:00.506279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:00.507343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:00.507739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:00.508111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] PATH_INFO: `/v3/projects/b300090b268d4745a7380cf32b7c3f95` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:00.509565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b300090b268d4745a7380cf32b7c3f95)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:00.511791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:00.696894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b300090b268d4745a7380cf32b7c3f95', 'request_id': 'req-d694cce2-97a9-46d4-b5eb-7c518849dcb4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:00.712489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b300090b268d4745a7380cf32b7c3f95', 'request_id': 'req-d694cce2-97a9-46d4-b5eb-7c518849dcb4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:00.821388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b300090b268d4745a7380cf32b7c3f95', 'request_id': 'req-d694cce2-97a9-46d4-b5eb-7c518849dcb4'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:00.838983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] The token cache is being invalidate because project b300090b268d4745a7380cf32b7c3f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:27:00.839610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:00.840947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d694cce2-97a9-46d4-b5eb-7c518849dcb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:00.844494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1111/2225] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:27:00 2022] DELETE /identity/v3/projects/b300090b268d4745a7380cf32b7c3f95 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:00.854457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ec4f-201a-433e-b7b4-1314797ee8bb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:00.855282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ec4f-201a-433e-b7b4-1314797ee8bb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:00.855481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12ec4f-201a-433e-b7b4-1314797ee8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:00.897609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9e12ec4f-201a-433e-b7b4-1314797ee8bb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:00.900172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9e12ec4f-201a-433e-b7b4-1314797ee8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:00.982355 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1115/2226] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:00.992158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1554416-8a6d-413e-be8e-816e680c3fdc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:00.992454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1554416-8a6d-413e-be8e-816e680c3fdc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:00.992765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1554416-8a6d-413e-be8e-816e680c3fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.014384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f1554416-8a6d-413e-be8e-816e680c3fdc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:01.016539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f1554416-8a6d-413e-be8e-816e680c3fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:01.032003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1112/2227] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:01.037106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ec4f-201a-433e-b7b4-1314797ee8bb None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:01.049818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e12ec4f-201a-433e-b7b4-1314797ee8bb None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:01.056114 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:01.057518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.057972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.058343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.060784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:27:01.060784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:01.061595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:01.076907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1116/2228] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:27:01.081752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1554416-8a6d-413e-be8e-816e680c3fdc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:01.092897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1554416-8a6d-413e-be8e-816e680c3fdc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:01.104339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:01.106086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.106086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.106086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.107098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:01.109985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:01.232722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1113/2229] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:27:01 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:01.233399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:01.252634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2076352f-812b-4f43-b6b5-bdc3295c786b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:01.364304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:01.365131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.365425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.365713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.366568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:01.368938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:01.479693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1117/2230] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:27:01 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:01.484707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:01.495735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939f87e-b500-4526-ae4e-f6dbad23a731 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:01.501732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:01.502422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.502840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.502995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.503693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:01.505538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:01.524378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1114/2231] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:27:01.525651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:01.543650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf216a1e-f5db-46ce-a6df-29ed46791b1b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:01.549434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719f96a-cf4e-4215-99c7-31e96e20e25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:01.550120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f96a-cf4e-4215-99c7-31e96e20e25f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.551223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f96a-cf4e-4215-99c7-31e96e20e25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.551223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719f96a-cf4e-4215-99c7-31e96e20e25f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.551532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f96a-cf4e-4215-99c7-31e96e20e25f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:01.553162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719f96a-cf4e-4215-99c7-31e96e20e25f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:01.565624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1118/2232] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:27:01.570420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:01.584470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe71de-3d5a-4288-b31a-d1c76ae603b8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:01.597672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:01.598594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.598885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.599168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] PATH_INFO: `/v3/projects/0d2d09ad67f84b41b673914db3829bb8/users/8e6e21e23d9a4e21b535bb74c635636c/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.618526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d2d09ad67f84b41b673914db3829bb8, user_id=8e6e21e23d9a4e21b535bb74c635636c, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:01.622103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:01.724736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1115/2233] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:27:01 2022] PUT /identity/v3/projects/0d2d09ad67f84b41b673914db3829bb8/users/8e6e21e23d9a4e21b535bb74c635636c/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:01.736628 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c46b-4559-435e-be0b-32a55286d82f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.736914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c46b-4559-435e-be0b-32a55286d82f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.737235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c46b-4559-435e-be0b-32a55286d82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.780162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-57c8c46b-4559-435e-be0b-32a55286d82f None None] MFA Rules not processed for user `8e6e21e23d9a4e21b535bb74c635636c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:01.781709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-57c8c46b-4559-435e-be0b-32a55286d82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:01.847514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:01.880910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1119/2234] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:01.886195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:01.976847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe2d847-f344-40a4-bca7-21d8f3a493a8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:01.982637 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:01.982817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:01.983081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:01.983355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:01.984214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:01.986765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:02.120706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1116/2235] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:27:01 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:27:02.126505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c46b-4559-435e-be0b-32a55286d82f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:02.141398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c46b-4559-435e-be0b-32a55286d82f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:02.237953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:02.239983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:02.239983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:02.239983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:02.240469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:02.242575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:02.358244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1120/2236] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:27:02 2022] POST /identity/v3/users => generated 298 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:02.371845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:02.388196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a52fd-2ea9-429c-ad81-8f6c6a35243c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:02.398517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:02.399496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:02.400827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:02.401249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:02.402221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:02.404181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:02.412176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:02.425486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1117/2237] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:27:02.431679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:02.448884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c65c-39b4-4c2e-ab8f-e9ecbb4fb079 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:02.467549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:02.469694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:02.470204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:02.470712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] PATH_INFO: `/v3/projects/55b9b19806e14cebac05635d38daae32/users/87a86bf016314535bee0cdd5a24b4735/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:02.509002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b9b19806e14cebac05635d38daae32, user_id=87a86bf016314535bee0cdd5a24b4735, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:02.515373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:02.612761 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1121/2238] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:27:02 2022] PUT /identity/v3/projects/55b9b19806e14cebac05635d38daae32/users/87a86bf016314535bee0cdd5a24b4735/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:27:02.613873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:02.629308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d35a9-3f53-463e-99f2-dda6951a8d1d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:02.731534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e401484-1450-4d35-8c79-5ec02ff2ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:02.732471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e401484-1450-4d35-8c79-5ec02ff2ab2b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:02.732679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e401484-1450-4d35-8c79-5ec02ff2ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:02.733056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e401484-1450-4d35-8c79-5ec02ff2ab2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:02.734779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e401484-1450-4d35-8c79-5ec02ff2ab2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:02.736699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e401484-1450-4d35-8c79-5ec02ff2ab2b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:02.751984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1118/2239] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:27:02.759228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:02.775122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b95531-b309-4f71-8a0e-d43c1840b38b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:02.783470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:02.784999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:02.785311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:02.785610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] PATH_INFO: `/v3/projects/55b9b19806e14cebac05635d38daae32/users/87a86bf016314535bee0cdd5a24b4735/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:02.788725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55b9b19806e14cebac05635d38daae32, user_id=87a86bf016314535bee0cdd5a24b4735, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:02.792707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:02.813241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1122/2240] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:27:02 2022] PUT /identity/v3/projects/55b9b19806e14cebac05635d38daae32/users/87a86bf016314535bee0cdd5a24b4735/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:02.826214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f498a4-ecb2-4e65-a426-ee4a164893dc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:02.826738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f498a4-ecb2-4e65-a426-ee4a164893dc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:02.827240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f498a4-ecb2-4e65-a426-ee4a164893dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:02.871550 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-25f498a4-ecb2-4e65-a426-ee4a164893dc None None] MFA Rules not processed for user `87a86bf016314535bee0cdd5a24b4735`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:02.872605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-25f498a4-ecb2-4e65-a426-ee4a164893dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:02.978919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1119/2241] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:02.986989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:02.988819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:03.064214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee7deb-c19d-4089-89ca-e6e6b9053948 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:03.068288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:03.069000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:03.069291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:03.069566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:03.088374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:03.090111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:03.102915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1123/2242] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:27:03.294761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f498a4-ecb2-4e65-a426-ee4a164893dc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:03.306553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f498a4-ecb2-4e65-a426-ee4a164893dc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:03.310627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d91e1d-e794-4f01-af2c-1372702575de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:03.311356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91e1d-e794-4f01-af2c-1372702575de service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:03.311647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91e1d-e794-4f01-af2c-1372702575de service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:03.314504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d91e1d-e794-4f01-af2c-1372702575de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:03.380432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d91e1d-e794-4f01-af2c-1372702575de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:03.381964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d91e1d-e794-4f01-af2c-1372702575de service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:03.392353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1120/2243] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:04.051139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:04.106927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:04.135953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9cb622-e7b9-4f31-8141-8a7f1070cce6 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:04.143822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:04.145630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:04.146147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:04.146500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] PATH_INFO: `/v3/users/8e6e21e23d9a4e21b535bb74c635636c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:04.147901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6e21e23d9a4e21b535bb74c635636c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:04.150404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:04.608422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6e21e23d9a4e21b535bb74c635636c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:04.622073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6e21e23d9a4e21b535bb74c635636c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:04.629985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6e21e23d9a4e21b535bb74c635636c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:05.015077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6e21e23d9a4e21b535bb74c635636c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:05.017275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6e21e23d9a4e21b535bb74c635636c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:05.024814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1124/2244] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:27:04 2022] DELETE /identity/v3/users/8e6e21e23d9a4e21b535bb74c635636c => generated 0 bytes in 975 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:05.029579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:05.030448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:05.030716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:05.053640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:05.054854 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:05.073346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:05.133386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1121/2245] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:05.145500 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:05.147302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:05.218302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04791cde-0293-44b0-bac4-e6ad9cea74b8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:05.222491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:05.231699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:05.231699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:05.231699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:05.235878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:05.237432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:05.248294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1125/2246] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:05.777343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:05.779263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:05.795128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244e99b-0db1-4ba9-9031-2a22c08c0e1b None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:05.801562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:05.802756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:05.803042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:05.803538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] PATH_INFO: `/v3/projects/0d2d09ad67f84b41b673914db3829bb8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:05.804946 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d2d09ad67f84b41b673914db3829bb8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:05.807225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:05.980811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d2d09ad67f84b41b673914db3829bb8', 'request_id': 'req-73939307-6f31-4f90-b10e-041dbd3f7f80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:05.987214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d2d09ad67f84b41b673914db3829bb8', 'request_id': 'req-73939307-6f31-4f90-b10e-041dbd3f7f80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.100410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d2d09ad67f84b41b673914db3829bb8', 'request_id': 'req-73939307-6f31-4f90-b10e-041dbd3f7f80'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.126649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] The token cache is being invalidate because project 0d2d09ad67f84b41b673914db3829bb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:27:06.127031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.127659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.129565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1122/2247] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:27:05 2022] DELETE /identity/v3/projects/0d2d09ad67f84b41b673914db3829bb8 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:06.133737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:06.155049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569ad70-ae5e-4425-b08b-5719e24ed6b0 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:06.268377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:06.269301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:06.269588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:06.269864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] PATH_INFO: `/v3/users/87a86bf016314535bee0cdd5a24b4735` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:06.271175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a86bf016314535bee0cdd5a24b4735)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:06.273427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:06.281275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:06.469955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a86bf016314535bee0cdd5a24b4735'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.485461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a86bf016314535bee0cdd5a24b4735'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.496168 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a86bf016314535bee0cdd5a24b4735'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.598228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a86bf016314535bee0cdd5a24b4735'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.598792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-691ab6cb-8861-4996-8b74-cb7c2b11f4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a86bf016314535bee0cdd5a24b4735'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:06.606588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1126/2248] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:27:06 2022] DELETE /identity/v3/users/87a86bf016314535bee0cdd5a24b4735 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:07.063552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:07.065044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:07.079804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939307-6f31-4f90-b10e-041dbd3f7f80 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:07.154619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:07.155490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:07.155958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:07.156184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] PATH_INFO: `/v3/projects/55b9b19806e14cebac05635d38daae32` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:07.157614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55b9b19806e14cebac05635d38daae32)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:07.159544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:07.256375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:07.262210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55b9b19806e14cebac05635d38daae32', 'request_id': 'req-eab454b1-af59-4c69-a744-d20c01c3f820'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:07.269107 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55b9b19806e14cebac05635d38daae32', 'request_id': 'req-eab454b1-af59-4c69-a744-d20c01c3f820'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:07.393210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55b9b19806e14cebac05635d38daae32', 'request_id': 'req-eab454b1-af59-4c69-a744-d20c01c3f820'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:07.408043 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] The token cache is being invalidate because project 55b9b19806e14cebac05635d38daae32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:27:07.408341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:07.409203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-eab454b1-af59-4c69-a744-d20c01c3f820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:07.410771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1123/2249] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:27:07 2022] DELETE /identity/v3/projects/55b9b19806e14cebac05635d38daae32 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:07.415951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09bd0-a4d3-459b-b062-807bd18093e6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:07.416599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09bd0-a4d3-459b-b062-807bd18093e6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:07.416599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b09bd0-a4d3-459b-b062-807bd18093e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:07.436327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f3b09bd0-a4d3-459b-b062-807bd18093e6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:07.438350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f3b09bd0-a4d3-459b-b062-807bd18093e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:07.518308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1127/2250] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:07.526780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d804e4-c887-4ee5-ad57-de2cf61beb95 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:07.531709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d804e4-c887-4ee5-ad57-de2cf61beb95 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:07.531709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d804e4-c887-4ee5-ad57-de2cf61beb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:07.547484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a3d804e4-c887-4ee5-ad57-de2cf61beb95 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:07.548692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3d804e4-c887-4ee5-ad57-de2cf61beb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:07.557052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1124/2251] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:07.561314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b09bd0-a4d3-459b-b062-807bd18093e6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:07.572191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b09bd0-a4d3-459b-b062-807bd18093e6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:07.576930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:07.577903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:07.578233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:07.578592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:07.579432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:27:07.579738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:07.581375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:07.595797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1128/2252] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:27:07.602344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d804e4-c887-4ee5-ad57-de2cf61beb95 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:07.613166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d804e4-c887-4ee5-ad57-de2cf61beb95 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:07.618447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:07.619260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:07.619441 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:07.619720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:07.620455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:07.622433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:07.732408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1125/2253] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:27:07 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:07.737702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:07.774254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5929f8-acc7-45db-b96a-9b83e33d1b19 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:07.870074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:07.870775 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:07.871064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:07.871557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:07.872271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:07.874426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:07.992138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1129/2254] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:27:07 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:07.998033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:08.009860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a4005-1940-40c7-a979-ccc9f444a57b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:08.015060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:08.016409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:08.016694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:08.016967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:08.017928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:08.019681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:08.034421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1126/2255] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:27:08.039390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:08.059468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:08.067543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093221d4-fd54-4556-92e3-6851bf5af2ed admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:08.076328 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6065e2-6594-4826-9b37-da38a9771ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:08.077191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6065e2-6594-4826-9b37-da38a9771ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:08.078295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6065e2-6594-4826-9b37-da38a9771ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:08.078777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6065e2-6594-4826-9b37-da38a9771ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:08.080172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6065e2-6594-4826-9b37-da38a9771ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:08.081776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6065e2-6594-4826-9b37-da38a9771ddd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:08.096436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1130/2256] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:27:08.100951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:08.112773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b21b5-e4f2-40bf-b9fe-5c99ba9b87ee admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:08.118304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:08.119197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:08.119540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:08.119765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] PATH_INFO: `/v3/projects/da2faa2dc14644ddbca412b80cd08c3b/users/a8765b97a45844f6ad848df10213014c/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:08.137184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2faa2dc14644ddbca412b80cd08c3b, user_id=a8765b97a45844f6ad848df10213014c, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:08.140592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:08.205456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1127/2257] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:27:08 2022] PUT /identity/v3/projects/da2faa2dc14644ddbca412b80cd08c3b/users/a8765b97a45844f6ad848df10213014c/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:27:08.216295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:08.216591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:08.216877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:08.248691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] MFA Rules not processed for user `a8765b97a45844f6ad848df10213014c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:08.251870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:08.341316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1131/2258] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:08.353311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:08.355581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:08.421778 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a14527-62d5-4632-b85d-801b02ab190a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:08.425650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d1968f-e624-433e-aad9-f63563f0f5b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:08.426354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1968f-e624-433e-aad9-f63563f0f5b0 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:08.426641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1968f-e624-433e-aad9-f63563f0f5b0 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:08.426911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d1968f-e624-433e-aad9-f63563f0f5b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:08.441834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1968f-e624-433e-aad9-f63563f0f5b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:08.443283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d1968f-e624-433e-aad9-f63563f0f5b0 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:08.452498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1128/2259] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:13.142895 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:13.144474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:13.222951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef2be2-f016-4c1f-af1c-f91cd3e4107e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:13.228897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:13.229859 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:13.230225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:13.230525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] PATH_INFO: `/v3/users/a941e179adb548d786bea92dc4a4db6e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:13.231866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a941e179adb548d786bea92dc4a4db6e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:13.234451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:13.452158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a941e179adb548d786bea92dc4a4db6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:13.468643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a941e179adb548d786bea92dc4a4db6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:13.476657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a941e179adb548d786bea92dc4a4db6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:13.621096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a941e179adb548d786bea92dc4a4db6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:13.621899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a941e179adb548d786bea92dc4a4db6e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:13.625802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:13.634316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1132/2260] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:27:13 2022] DELETE /identity/v3/users/a941e179adb548d786bea92dc4a4db6e => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:13.641020 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:13.641638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:13.641638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:13.664169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:13.665913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:13.750328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1129/2261] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:27:13.766515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:13.767469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:13.835893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f79ff2e-ac09-47ba-b6bc-4599a22d5f82 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:13.841671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576dfd5-0b1a-434e-8e1d-a91d956ee4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:13.842693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576dfd5-0b1a-434e-8e1d-a91d956ee4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:13.842693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576dfd5-0b1a-434e-8e1d-a91d956ee4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:13.843495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576dfd5-0b1a-434e-8e1d-a91d956ee4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:13.854461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576dfd5-0b1a-434e-8e1d-a91d956ee4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:13.857002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3576dfd5-0b1a-434e-8e1d-a91d956ee4e2 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:13.869609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1133/2262] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:27:14.423710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:14.425411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:14.440348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe5e5c-605f-48a4-b24d-4423915ac967 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:14.446639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:14.447537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:14.447936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:14.448526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] PATH_INFO: `/v3/projects/eba4ff8128484505ac67e970ef4ca00d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:14.450976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eba4ff8128484505ac67e970ef4ca00d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:14.451845 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:14.455063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:14.605013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eba4ff8128484505ac67e970ef4ca00d', 'request_id': 'req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:14.613875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eba4ff8128484505ac67e970ef4ca00d', 'request_id': 'req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:14.683920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eba4ff8128484505ac67e970ef4ca00d', 'request_id': 'req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:14.700192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] The token cache is being invalidate because project eba4ff8128484505ac67e970ef4ca00d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:27:14.700481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:14.701398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:14.703356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1130/2263] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:27:14 2022] DELETE /identity/v3/projects/eba4ff8128484505ac67e970ef4ca00d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:16.933072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930b08-309d-4fdd-b577-ff8d5214d145 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:16.933501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930b08-309d-4fdd-b577-ff8d5214d145 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:16.933608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45930b08-309d-4fdd-b577-ff8d5214d145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:16.956283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-45930b08-309d-4fdd-b577-ff8d5214d145 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:16.957568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-45930b08-309d-4fdd-b577-ff8d5214d145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:17.041719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1134/2264] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:27:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:27:17.064813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:17.066366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:17.153719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d9c60-90fb-429e-ae21-b1ee57028ce3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:17.160394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:17.161103 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:17.161399 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:17.163989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:17.171546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:17.173656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:17.184842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1131/2265] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:27:22.776658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200026-d39e-4280-93fb-7d9315e487e2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:22.777375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200026-d39e-4280-93fb-7d9315e487e2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:22.777375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc200026-d39e-4280-93fb-7d9315e487e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:22.797805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cc200026-d39e-4280-93fb-7d9315e487e2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:22.802190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cc200026-d39e-4280-93fb-7d9315e487e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:22.807781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1135/2266] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:22.829510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:22.831187 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:22.847897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966faf28-a355-476f-8440-b533e9e35bc7 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:22.854048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:22.854793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:22.855080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:22.855353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:22.865436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:22.867057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:22.878366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1132/2267] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:28.466345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:28.466938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:28.467105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:28.488442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:28.489748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:28.497910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1136/2268] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:28.518371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:28.532420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f05-8b71-4f8c-ad11-3285f09cec6b service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:28.538907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28ee4a-bb62-4997-b5f2-70020ddb982c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:28.538907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ee4a-bb62-4997-b5f2-70020ddb982c service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:28.539274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ee4a-bb62-4997-b5f2-70020ddb982c service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:28.539423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28ee4a-bb62-4997-b5f2-70020ddb982c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:28.549403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28ee4a-bb62-4997-b5f2-70020ddb982c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:28.551061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28ee4a-bb62-4997-b5f2-70020ddb982c service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:28.562789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1133/2269] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:30.470713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:30.472248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:30.485773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828693-45e4-4df6-ab54-4eab05d64289 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:30.490678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:30.491566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:30.491850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:30.492127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] PATH_INFO: `/v3/users/a8765b97a45844f6ad848df10213014c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:30.493441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8765b97a45844f6ad848df10213014c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:30.495520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:30.683960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8765b97a45844f6ad848df10213014c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:30.700434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8765b97a45844f6ad848df10213014c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:30.709791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8765b97a45844f6ad848df10213014c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:30.837399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8765b97a45844f6ad848df10213014c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:30.838028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8765b97a45844f6ad848df10213014c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:30.845375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1137/2270] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:27:30 2022] DELETE /identity/v3/users/a8765b97a45844f6ad848df10213014c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:30.849960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:30.851358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:30.851358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:30.868739 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:30.869993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:30.917011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:30.931615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1134/2271] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:30.942640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:30.944082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:30.949570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:31.004610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0326dd-8032-4686-b760-07b28cf1a9ea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:31.008313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d56744b-ecb2-4176-897b-d323b06aa11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:31.009120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56744b-ecb2-4176-897b-d323b06aa11c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:31.009412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56744b-ecb2-4176-897b-d323b06aa11c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:31.009693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d56744b-ecb2-4176-897b-d323b06aa11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:31.020876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56744b-ecb2-4176-897b-d323b06aa11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:31.022944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d56744b-ecb2-4176-897b-d323b06aa11c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:31.034392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1138/2272] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:31.522915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:31.525087 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:31.549138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2fd24a-5d2f-4c70-be57-10b365df4fa8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:31.562860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:31.562860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:31.562860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:31.562860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] PATH_INFO: `/v3/projects/da2faa2dc14644ddbca412b80cd08c3b` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:31.563545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2faa2dc14644ddbca412b80cd08c3b)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:31.563545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:31.677500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2faa2dc14644ddbca412b80cd08c3b', 'request_id': 'req-46bbdf62-be85-4a84-98c6-8e66fa8387c1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:31.688395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2faa2dc14644ddbca412b80cd08c3b', 'request_id': 'req-46bbdf62-be85-4a84-98c6-8e66fa8387c1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:31.769360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2faa2dc14644ddbca412b80cd08c3b', 'request_id': 'req-46bbdf62-be85-4a84-98c6-8e66fa8387c1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:31.785228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] The token cache is being invalidate because project da2faa2dc14644ddbca412b80cd08c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:27:31.785759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:31.786922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-46bbdf62-be85-4a84-98c6-8e66fa8387c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:31.789817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1135/2273] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:27:31 2022] DELETE /identity/v3/projects/da2faa2dc14644ddbca412b80cd08c3b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:27:31.796147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf65bf-5082-4a22-a40a-a897754ed3ee None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:31.796957 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf65bf-5082-4a22-a40a-a897754ed3ee None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:31.797485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf65bf-5082-4a22-a40a-a897754ed3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:31.829599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d3bf65bf-5082-4a22-a40a-a897754ed3ee None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:31.831832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d3bf65bf-5082-4a22-a40a-a897754ed3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:31.918754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1139/2274] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:31.992436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dcc9-71d2-41b0-b137-af5758ac5a5c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:31.993096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dcc9-71d2-41b0-b137-af5758ac5a5c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:31.993096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dcc9-71d2-41b0-b137-af5758ac5a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.019119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f381dcc9-71d2-41b0-b137-af5758ac5a5c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:32.020237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f381dcc9-71d2-41b0-b137-af5758ac5a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:32.030530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1136/2275] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:32.035326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf65bf-5082-4a22-a40a-a897754ed3ee None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.046556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf65bf-5082-4a22-a40a-a897754ed3ee None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.051805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.052493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.052780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.053115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.053910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:27:32.054222 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.055893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.071099 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1140/2276] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:27:32.077932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dcc9-71d2-41b0-b137-af5758ac5a5c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.091927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dcc9-71d2-41b0-b137-af5758ac5a5c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.101261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdbd53-d6a4-468c-a399-b0694d34510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.101261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdbd53-d6a4-468c-a399-b0694d34510c admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.101261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdbd53-d6a4-468c-a399-b0694d34510c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.101261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdbd53-d6a4-468c-a399-b0694d34510c admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.102307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdbd53-d6a4-468c-a399-b0694d34510c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.103798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdbd53-d6a4-468c-a399-b0694d34510c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.219966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1137/2277] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:27:32 2022] POST /identity/v3/projects => generated 361 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:32.225650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.246219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1764ce-56e2-4831-95b1-df154d5f020d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.323136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.323817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.324101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.324376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.325093 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.327254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.404526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1141/2278] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:27:32 2022] POST /identity/v3/users => generated 281 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:32.411084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd44a-00f7-4f05-a14b-4948d9a70155 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.411276 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.411415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd44a-00f7-4f05-a14b-4948d9a70155 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.411826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05efd44a-00f7-4f05-a14b-4948d9a70155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.422860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d2a09-a7e5-4285-ac38-d773d73111b4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.428072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.429158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.429451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.429736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.430475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.432100 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.435651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-05efd44a-00f7-4f05-a14b-4948d9a70155 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:32.437900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-05efd44a-00f7-4f05-a14b-4948d9a70155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:32.449259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1142/2279] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:27:32.449532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1138/2280] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:32.450339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efd44a-00f7-4f05-a14b-4948d9a70155 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.460730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05efd44a-00f7-4f05-a14b-4948d9a70155 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.464460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.466326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:32.466636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.467836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.468130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.468412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.469197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.470876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.482787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:32.490449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1139/2281] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:27:32.492224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.504098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d0ff6-f8b8-4c87-9cb3-b1ef8a1d31b3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.516046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.516046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.516046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.516046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] PATH_INFO: `/v3/projects/f641b001e42549ec90a83c8b112283dd/users/cf18286aa8bf4fa18effe632e62a3294/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.543753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f641b001e42549ec90a83c8b112283dd, user_id=cf18286aa8bf4fa18effe632e62a3294, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.550250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.554091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57cffb0-0e04-4d4c-abc6-727f1fad614e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.560434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530c4fb-11c4-494e-8b71-51ca1ccc98cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.561122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c4fb-11c4-494e-8b71-51ca1ccc98cf service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.561610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c4fb-11c4-494e-8b71-51ca1ccc98cf service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.561979 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530c4fb-11c4-494e-8b71-51ca1ccc98cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.571897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c4fb-11c4-494e-8b71-51ca1ccc98cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.573619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530c4fb-11c4-494e-8b71-51ca1ccc98cf service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.585587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1143/2282] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:27:32.640237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1140/2283] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:27:32 2022] PUT /identity/v3/projects/f641b001e42549ec90a83c8b112283dd/users/cf18286aa8bf4fa18effe632e62a3294/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:27:32.651466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19976c-4ede-4487-a674-a97847d31c3e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.651762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19976c-4ede-4487-a674-a97847d31c3e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.652043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19976c-4ede-4487-a674-a97847d31c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.683543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7a19976c-4ede-4487-a674-a97847d31c3e None None] MFA Rules not processed for user `cf18286aa8bf4fa18effe632e62a3294`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:32.684805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7a19976c-4ede-4487-a674-a97847d31c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:32.784701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1144/2284] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:32.824189 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:32.826126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:32.894121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb170c-372d-42db-8539-efcd3af8583a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:32.900517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433544a-8986-43d0-88d4-17687556a274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:32.901676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433544a-8986-43d0-88d4-17687556a274 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:32.902173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433544a-8986-43d0-88d4-17687556a274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:32.902664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433544a-8986-43d0-88d4-17687556a274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:32.919212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433544a-8986-43d0-88d4-17687556a274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:32.922879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433544a-8986-43d0-88d4-17687556a274 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:32.941132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1141/2285] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:32.956052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19976c-4ede-4487-a674-a97847d31c3e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:33.024630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19976c-4ede-4487-a674-a97847d31c3e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:33.029348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:33.030351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:33.030642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:33.030947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] PATH_INFO: `/v3/users/cf18286aa8bf4fa18effe632e62a3294` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:33.032267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf18286aa8bf4fa18effe632e62a3294)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:33.034539 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:33.126397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:33.247729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf18286aa8bf4fa18effe632e62a3294'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:33.261955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf18286aa8bf4fa18effe632e62a3294'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:33.270107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf18286aa8bf4fa18effe632e62a3294'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:33.345890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf18286aa8bf4fa18effe632e62a3294'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:33.346517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf18286aa8bf4fa18effe632e62a3294'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:33.353434 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1145/2286] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:27:32 2022] DELETE /identity/v3/users/cf18286aa8bf4fa18effe632e62a3294 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:33.358310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:33.359352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:33.365659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:33.372654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:33.379949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:33.381199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:33.451528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1142/2287] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:33.462624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:33.464102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:33.535465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da869b-e1b1-4cdf-96dc-ab568e737a9b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:33.539311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ca353-344c-49c9-9132-5078d167abf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:33.539965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ca353-344c-49c9-9132-5078d167abf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:33.540258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ca353-344c-49c9-9132-5078d167abf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:33.540566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ca353-344c-49c9-9132-5078d167abf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:33.551007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ca353-344c-49c9-9132-5078d167abf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:33.552446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ca353-344c-49c9-9132-5078d167abf6 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:33.563280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1146/2288] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:27:33.999606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:34.006680 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:34.015236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a297b-e49d-4f71-957f-35fa3e25f499 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:34.026100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:34.027021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.027302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.027577 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] PATH_INFO: `/v3/projects/f641b001e42549ec90a83c8b112283dd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.028898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f641b001e42549ec90a83c8b112283dd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:34.032088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:34.157596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f641b001e42549ec90a83c8b112283dd', 'request_id': 'req-81c3e225-8f0c-4770-b948-75d75e310d01'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:34.163884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f641b001e42549ec90a83c8b112283dd', 'request_id': 'req-81c3e225-8f0c-4770-b948-75d75e310d01'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:34.243487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f641b001e42549ec90a83c8b112283dd', 'request_id': 'req-81c3e225-8f0c-4770-b948-75d75e310d01'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:34.256393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] The token cache is being invalidate because project f641b001e42549ec90a83c8b112283dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:27:34.256692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:34.257383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81c3e225-8f0c-4770-b948-75d75e310d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:27:34.259001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1143/2289] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:27:33 2022] DELETE /identity/v3/projects/f641b001e42549ec90a83c8b112283dd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:34.264049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca54f2-245c-4835-bc37-d5d1211af101 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.264767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca54f2-245c-4835-bc37-d5d1211af101 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.264767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca54f2-245c-4835-bc37-d5d1211af101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.286038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-10ca54f2-245c-4835-bc37-d5d1211af101 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:34.287397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-10ca54f2-245c-4835-bc37-d5d1211af101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:34.357899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1147/2290] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:27:34.366561 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251d456-c191-4024-b0dc-c5313e856f56 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.367061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251d456-c191-4024-b0dc-c5313e856f56 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.367152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251d456-c191-4024-b0dc-c5313e856f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.385859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e251d456-c191-4024-b0dc-c5313e856f56 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:34.387069 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e251d456-c191-4024-b0dc-c5313e856f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:34.396467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1144/2291] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:34.401081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca54f2-245c-4835-bc37-d5d1211af101 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:34.411824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca54f2-245c-4835-bc37-d5d1211af101 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:34.419037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:34.419037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.419037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.419037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.419550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:27:34.419645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:34.422241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:34.438633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1148/2292] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:27:34.444703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251d456-c191-4024-b0dc-c5313e856f56 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:34.456048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251d456-c191-4024-b0dc-c5313e856f56 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:34.461009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:34.461734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.462017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.462292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.462990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:34.464963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:34.576179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1145/2293] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:27:34 2022] POST /identity/v3/projects => generated 363 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:34.581606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:34.591728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fcf8e3-c754-46e9-af6c-2499d667ba9d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:34.635315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:34.662489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:34.663191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.663469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.663746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.664439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:34.666495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:34.735406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1149/2294] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:27:34 2022] POST /identity/v3/users => generated 282 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:27:34.740022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:34.751824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4dce07-c4ab-44b7-9a9b-2463acc08a4b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:34.756894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:34.757610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.757892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.758182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.758923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:34.760548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:34.773502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1146/2295] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:27:34.779493 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:34.790976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7639a16-d957-4e7e-8268-5e2b3d7c12ab admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:34.795776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed1c6-ae58-4d7b-84fa-c50e4b09576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:34.796455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed1c6-ae58-4d7b-84fa-c50e4b09576f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.796751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed1c6-ae58-4d7b-84fa-c50e4b09576f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.797054 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed1c6-ae58-4d7b-84fa-c50e4b09576f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.797797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed1c6-ae58-4d7b-84fa-c50e4b09576f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:34.799416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed1c6-ae58-4d7b-84fa-c50e4b09576f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:34.810301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1150/2296] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:27:34.816046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:34.826613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd02ed-5ced-4147-84f1-d113c96a5ad4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:34.832398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:34.833338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.833631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.833908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] PATH_INFO: `/v3/projects/c0742ab568dc43beab48e359ba6dd1cf/users/00c744c91ef04e278e90556d5030afe5/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.851073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0742ab568dc43beab48e359ba6dd1cf, user_id=00c744c91ef04e278e90556d5030afe5, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:34.853787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:34.947083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1147/2297] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:27:34 2022] PUT /identity/v3/projects/c0742ab568dc43beab48e359ba6dd1cf/users/00c744c91ef04e278e90556d5030afe5/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:27:34.959106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f3ea2-9ca8-4f8c-b984-431be497ec71 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:34.959470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f3ea2-9ca8-4f8c-b984-431be497ec71 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:34.959870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f3ea2-9ca8-4f8c-b984-431be497ec71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:34.994540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b17f3ea2-9ca8-4f8c-b984-431be497ec71 None None] MFA Rules not processed for user `00c744c91ef04e278e90556d5030afe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:34.995844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b17f3ea2-9ca8-4f8c-b984-431be497ec71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:35.079745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1151/2298] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:35.080181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:35.080927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:35.114050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:35.142715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ba309-022e-40a2-a28d-e9dbd20ac252 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:35.147384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:35.148410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:35.148731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:35.149149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:35.162800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:35.165694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:35.175829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1148/2299] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:36.754743 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309734e-168e-4381-8b29-e46ba56ba760 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:36.755361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309734e-168e-4381-8b29-e46ba56ba760 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:36.755361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309734e-168e-4381-8b29-e46ba56ba760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:36.776866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c309734e-168e-4381-8b29-e46ba56ba760 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:36.778127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c309734e-168e-4381-8b29-e46ba56ba760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:36.855226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1152/2300] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:36.876256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:36.878738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:36.961304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b8924-43f6-4727-8d23-204b1f6cc895 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:36.966682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:36.967363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:36.967796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:36.968288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:36.977439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:36.979035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:36.989940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1149/2301] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:40.986496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:40.987041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:40.987041 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:41.006622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:41.007904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:41.020400 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1153/2302] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:27:41.045037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:41.057439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd4ca7-2a7f-43df-ac21-a305f29d5e98 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:41.064037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ed849-91f4-4218-a83e-f2f28826a310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:41.073924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ed849-91f4-4218-a83e-f2f28826a310 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:41.073924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ed849-91f4-4218-a83e-f2f28826a310 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:41.073924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ed849-91f4-4218-a83e-f2f28826a310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:41.076044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ed849-91f4-4218-a83e-f2f28826a310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:41.078509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ed849-91f4-4218-a83e-f2f28826a310 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:41.089486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1150/2303] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:44.247931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:27:44.250088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:44.310186 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:44.337170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fa09b-b8b2-4c88-afc0-c6d0d080672b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:27:44.343645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fda6d3-e72c-4c55-82a9-e557290d3693 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:27:44.344373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda6d3-e72c-4c55-82a9-e557290d3693 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:44.344667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda6d3-e72c-4c55-82a9-e557290d3693 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:44.344968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fda6d3-e72c-4c55-82a9-e557290d3693 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:44.346835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-12fda6d3-e72c-4c55-82a9-e557290d3693 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:44.362064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fda6d3-e72c-4c55-82a9-e557290d3693 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:27:44.363703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fda6d3-e72c-4c55-82a9-e557290d3693 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:27:44.375079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1154/2304] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:27:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:27:51.084727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=54 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:54.602923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=15 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:27:59.868462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:27:59.869078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:27:59.869078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:27:59.894371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] MFA Rules not processed for user `24e68c42d0964540bbf78fbf2faf0ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:27:59.896415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:27:59.966098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1151/2305] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:27:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:08.761491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c3884-abe3-4eed-8bdc-236cf4528688 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:08.763011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c3884-abe3-4eed-8bdc-236cf4528688 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:08.763913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c3884-abe3-4eed-8bdc-236cf4528688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:08.787813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-083c3884-abe3-4eed-8bdc-236cf4528688 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:08.789592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-083c3884-abe3-4eed-8bdc-236cf4528688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:08.872461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1155/2306] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:28:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:09.005907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:09.007584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:09.107517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61778f5-ebbc-46e5-885e-9491d69a4d6f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:09.115231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd67fa78-f7ec-47ba-8a96-620df33ec700 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:09.116031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67fa78-f7ec-47ba-8a96-620df33ec700 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:09.116385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67fa78-f7ec-47ba-8a96-620df33ec700 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:09.116734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd67fa78-f7ec-47ba-8a96-620df33ec700 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:09.128177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67fa78-f7ec-47ba-8a96-620df33ec700 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:09.130245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd67fa78-f7ec-47ba-8a96-620df33ec700 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:09.138948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1152/2307] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:28:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:28:14.850967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c3884-abe3-4eed-8bdc-236cf4528688 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:14.880482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c3884-abe3-4eed-8bdc-236cf4528688 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:14.885661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:14.886750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:14.887138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:14.887520 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] PATH_INFO: `/v3/users/00c744c91ef04e278e90556d5030afe5` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:14.889899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c744c91ef04e278e90556d5030afe5)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:14.891985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:15.181810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c744c91ef04e278e90556d5030afe5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:15.221958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c744c91ef04e278e90556d5030afe5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:15.236341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c744c91ef04e278e90556d5030afe5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:15.359451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c744c91ef04e278e90556d5030afe5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:15.359451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c744c91ef04e278e90556d5030afe5'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:15.364139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1156/2308] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:28:14 2022] DELETE /identity/v3/users/00c744c91ef04e278e90556d5030afe5 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:28:15.368677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:15.369310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:15.371607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:15.408587 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:15.410020 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:15.543065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1153/2309] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:15.562587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:15.566864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:15.687169 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e90fc-6a69-46f4-9459-aa5fd56b8f88 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:15.699212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c575c65-1a9b-44b3-8c21-7b3dd2164400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:15.700155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c575c65-1a9b-44b3-8c21-7b3dd2164400 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:15.700537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c575c65-1a9b-44b3-8c21-7b3dd2164400 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:15.701214 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c575c65-1a9b-44b3-8c21-7b3dd2164400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:15.722044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c575c65-1a9b-44b3-8c21-7b3dd2164400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:15.723684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c575c65-1a9b-44b3-8c21-7b3dd2164400 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:15.739904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1157/2310] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:16.348229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:16.350192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:16.373667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d2d4-95f0-4ee7-8572-9b638acb8b3f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:16.384822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:16.386832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:16.387555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:16.388906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] PATH_INFO: `/v3/projects/c0742ab568dc43beab48e359ba6dd1cf` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:16.391461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0742ab568dc43beab48e359ba6dd1cf)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:16.394008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:16.506650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:28:16.550046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0742ab568dc43beab48e359ba6dd1cf', 'request_id': 'req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:16.566403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0742ab568dc43beab48e359ba6dd1cf', 'request_id': 'req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:16.650458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0742ab568dc43beab48e359ba6dd1cf', 'request_id': 'req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:16.681266 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] The token cache is being invalidate because project c0742ab568dc43beab48e359ba6dd1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:28:16.681509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:16.682654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:28:16.689732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1154/2311] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:28:16 2022] DELETE /identity/v3/projects/c0742ab568dc43beab48e359ba6dd1cf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:28:20.830537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1355-e39b-4427-830f-63c2d0f89b7f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:20.830537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1355-e39b-4427-830f-63c2d0f89b7f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:20.830537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b1355-e39b-4427-830f-63c2d0f89b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:20.856312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d95b1355-e39b-4427-830f-63c2d0f89b7f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:20.858966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d95b1355-e39b-4427-830f-63c2d0f89b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:20.882225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:28:20.970671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1158/2312] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:28:21.208453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:21.209976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:21.351967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ee2ef-9f5e-41e4-9b29-9c4578d6b366 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:21.358830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bff636-8918-4641-9029-5a937521a908 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:21.359953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff636-8918-4641-9029-5a937521a908 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:21.360257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff636-8918-4641-9029-5a937521a908 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:21.360524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff636-8918-4641-9029-5a937521a908 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:21.376404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bff636-8918-4641-9029-5a937521a908 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:21.378911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bff636-8918-4641-9029-5a937521a908 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:21.407109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1155/2313] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:22.550230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:22.550793 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:22.550910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:22.571950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] MFA Rules not processed for user `4b57f9679e65450b9d97b0ce893fd6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:22.573332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:22.652656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1159/2314] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:28:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:25.380622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a61a8-2dbe-462d-b77b-96711014ccda None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:25.381303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a61a8-2dbe-462d-b77b-96711014ccda None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:25.381303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71a61a8-2dbe-462d-b77b-96711014ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:25.401411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-b71a61a8-2dbe-462d-b77b-96711014ccda None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:25.402833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b71a61a8-2dbe-462d-b77b-96711014ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:25.411833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1156/2315] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:25.430704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:25.432315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:25.449913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47daa8-f869-455e-8134-bc1cc0cb3aa2 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:25.456514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:25.457223 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:25.457512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:25.457795 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:25.468055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:25.469754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:25.480617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1160/2316] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:30.390279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e618d-6923-4f5a-b78b-b1c47b866677 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:30.391243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e618d-6923-4f5a-b78b-b1c47b866677 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:30.391715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e618d-6923-4f5a-b78b-b1c47b866677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:30.431327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e68e618d-6923-4f5a-b78b-b1c47b866677 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:30.432656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e68e618d-6923-4f5a-b78b-b1c47b866677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:30.442282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1157/2317] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:30.458682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:30.473316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5ade37-9dec-4f10-944b-d5dd308fd85d service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:30.482776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d85a6d2-65b4-4788-bfb3-d9f7fb702d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:30.483659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a6d2-65b4-4788-bfb3-d9f7fb702d43 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:30.492162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a6d2-65b4-4788-bfb3-d9f7fb702d43 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:30.492162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d85a6d2-65b4-4788-bfb3-d9f7fb702d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:30.494108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85a6d2-65b4-4788-bfb3-d9f7fb702d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:30.495736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d85a6d2-65b4-4788-bfb3-d9f7fb702d43 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:30.513518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1161/2318] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:31.066695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb3622-12be-4e5d-b3bf-58fe778c4756 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.067885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb3622-12be-4e5d-b3bf-58fe778c4756 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.068172 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb3622-12be-4e5d-b3bf-58fe778c4756 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.071139 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1158/2319] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:28:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:28:31.082057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704b72d-550e-449d-aed4-aca5b34c20f4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.085810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704b72d-550e-449d-aed4-aca5b34c20f4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.085810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704b72d-550e-449d-aed4-aca5b34c20f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.112817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6704b72d-550e-449d-aed4-aca5b34c20f4 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:31.114180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6704b72d-550e-449d-aed4-aca5b34c20f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:31.128330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1162/2320] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:28:31.144038 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb3622-12be-4e5d-b3bf-58fe778c4756 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:31.146166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5abb3622-12be-4e5d-b3bf-58fe778c4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:31.232348 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb3622-12be-4e5d-b3bf-58fe778c4756 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:31.237531 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10634a7-6e2b-4dbe-af8b-c7eb4d73d609 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:31.239252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10634a7-6e2b-4dbe-af8b-c7eb4d73d609 service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.239547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10634a7-6e2b-4dbe-af8b-c7eb4d73d609 service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.239829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10634a7-6e2b-4dbe-af8b-c7eb4d73d609 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.252244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10634a7-6e2b-4dbe-af8b-c7eb4d73d609 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:31.253795 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10634a7-6e2b-4dbe-af8b-c7eb4d73d609 service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:31.266250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1159/2321] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:31.496672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e764c2-1d23-4c65-bc44-d84d6824dc52 None None] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.497156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e764c2-1d23-4c65-bc44-d84d6824dc52 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.497487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e764c2-1d23-4c65-bc44-d84d6824dc52 None None] PATH_INFO: `/` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.498804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1163/2322] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:28:31.504084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899f72-87f5-44d0-a304-60410aa4086c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.504596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899f72-87f5-44d0-a304-60410aa4086c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.504711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23899f72-87f5-44d0-a304-60410aa4086c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.524373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-23899f72-87f5-44d0-a304-60410aa4086c None None] MFA Rules not processed for user `aff4923457aa4be498f954c73f4d0018`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:31.525666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-23899f72-87f5-44d0-a304-60410aa4086c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:31.569685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:28:31.597077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1160/2323] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:31.620483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e764c2-1d23-4c65-bc44-d84d6824dc52 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:31.620483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a1e764c2-1d23-4c65-bc44-d84d6824dc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:31.631776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e764c2-1d23-4c65-bc44-d84d6824dc52 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:31.636834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c417a-ea70-4436-a0a6-15aa80ffbb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:31.638570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c417a-ea70-4436-a0a6-15aa80ffbb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.639016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c417a-ea70-4436-a0a6-15aa80ffbb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.642192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c417a-ea70-4436-a0a6-15aa80ffbb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.651130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c417a-ea70-4436-a0a6-15aa80ffbb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:31.652586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c417a-ea70-4436-a0a6-15aa80ffbb54 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:31.672030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1164/2324] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:31.829077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2d65d-9e9c-4748-b091-42f6ee849cd2 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.829589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2d65d-9e9c-4748-b091-42f6ee849cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.829878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2d65d-9e9c-4748-b091-42f6ee849cd2 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.831886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1161/2325] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:28:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:28:31.838629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd09178-de4a-4bf2-b115-91f72d9b91a0 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.838923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd09178-de4a-4bf2-b115-91f72d9b91a0 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.839208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd09178-de4a-4bf2-b115-91f72d9b91a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.860790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5bd09178-de4a-4bf2-b115-91f72d9b91a0 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:31.862057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5bd09178-de4a-4bf2-b115-91f72d9b91a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:31.871749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1165/2326] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:28:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:31.883499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2d65d-9e9c-4748-b091-42f6ee849cd2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:31.896085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2d65d-9e9c-4748-b091-42f6ee849cd2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:31.905657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:31.906321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:31.906606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:31.906886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:31.917977 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:31.919529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:31.931052 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1162/2327] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:33.638103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2405-3eae-41dc-b4b8-597f73316369 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:33.638845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2405-3eae-41dc-b4b8-597f73316369 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:33.638845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af2405-3eae-41dc-b4b8-597f73316369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:33.660494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-31af2405-3eae-41dc-b4b8-597f73316369 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:33.661871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-31af2405-3eae-41dc-b4b8-597f73316369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:33.671158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1166/2328] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:33.688160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:33.705285 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2c842f-32a7-4311-8bfe-65789a3eae0f service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:33.711202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:33.711855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:33.712140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:33.712417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:33.721784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:33.723392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:33.734876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1163/2329] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:38.045025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd899-d25f-4d69-ac54-05e85a78868f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:38.045603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd899-d25f-4d69-ac54-05e85a78868f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:38.045603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadbd899-d25f-4d69-ac54-05e85a78868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:38.069498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dadbd899-d25f-4d69-ac54-05e85a78868f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:38.071058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dadbd899-d25f-4d69-ac54-05e85a78868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:38.085494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1167/2330] 10.222.0.30 () {58 vars in 1016 bytes} [Mon Jul 18 06:28:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:38.106895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:38.120427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aec85e-0882-4431-9f66-19cdb289943d service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:38.127346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225312d6-a232-42ae-aa84-9847e57aae19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:38.128051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225312d6-a232-42ae-aa84-9847e57aae19 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:38.128335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225312d6-a232-42ae-aa84-9847e57aae19 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:38.128619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225312d6-a232-42ae-aa84-9847e57aae19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:38.138402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225312d6-a232-42ae-aa84-9847e57aae19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:38.140278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225312d6-a232-42ae-aa84-9847e57aae19 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:38.152032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1164/2331] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:28:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:28:38.495860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:38.496158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:38.496416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:38.520189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] MFA Rules not processed for user `1c4e450af95547bc9c633612b110858e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:38.523000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:38.601113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1168/2332] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:28:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:43.484233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfcbf-51c1-470c-aaea-d56736e0f702 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:43.485128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfcbf-51c1-470c-aaea-d56736e0f702 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:43.485128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bfcbf-51c1-470c-aaea-d56736e0f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:43.505712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e99bfcbf-51c1-470c-aaea-d56736e0f702 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:28:43.507061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e99bfcbf-51c1-470c-aaea-d56736e0f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:43.613624 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1165/2333] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:28:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:28:43.634015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:28:43.645078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:28:43.645078 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:28:43.772846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc879cf-4f00-4bab-b3a0-4ef6921e3a2d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:28:43.778796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:28:43.779489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:28:43.779778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:28:43.780061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:28:43.794096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:28:43.795978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:28:43.812580 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1169/2334] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:28:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:28:53.604540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=51 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:28:53.802906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=30 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:05.290406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9c47a-3d40-4a0e-82d4-644bdd696748 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:05.290934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9c47a-3d40-4a0e-82d4-644bdd696748 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:05.291327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9c47a-3d40-4a0e-82d4-644bdd696748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:05.320035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6ba9c47a-3d40-4a0e-82d4-644bdd696748 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:05.322021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6ba9c47a-3d40-4a0e-82d4-644bdd696748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:05.340791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1166/2335] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 18 06:29:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:05.348163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:05.360586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0bf26-9ded-4eb2-a033-568e107bcae8 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:05.367767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:05.375060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:05.375060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:05.375060 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:05.382250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:05.384174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:05.395023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1170/2336] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:29:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:29:09.618383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153128-caa2-4877-ab0b-a441f9e28969 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:09.618950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153128-caa2-4877-ab0b-a441f9e28969 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:09.619374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3153128-caa2-4877-ab0b-a441f9e28969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:09.648807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a3153128-caa2-4877-ab0b-a441f9e28969 None None] MFA Rules not processed for user `e7d1d99f0b074def89c572d944f8469a`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:09.651012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3153128-caa2-4877-ab0b-a441f9e28969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:09.741995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1167/2337] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:15.392345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:19.734931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=28 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:29.478877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:29.482357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:29.501584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc0607c-eb51-46e1-9fc8-f5a593d577be service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:29.506278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:29.507333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:29.507624 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:29.507903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] PATH_INFO: `/v3/users/24e68c42d0964540bbf78fbf2faf0ee0` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:29.509175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24e68c42d0964540bbf78fbf2faf0ee0)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:29.511650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:29.823776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24e68c42d0964540bbf78fbf2faf0ee0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:29.836474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24e68c42d0964540bbf78fbf2faf0ee0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:29.844244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24e68c42d0964540bbf78fbf2faf0ee0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:29.962115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24e68c42d0964540bbf78fbf2faf0ee0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:29.962749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-b55f82c3-e520-41ca-9663-2cda8cd29c21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24e68c42d0964540bbf78fbf2faf0ee0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:29.969617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1171/2338] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:29:29 2022] DELETE /identity/v3/users/24e68c42d0964540bbf78fbf2faf0ee0 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:29:30.222131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3153128-caa2-4877-ab0b-a441f9e28969 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:30.238443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3153128-caa2-4877-ab0b-a441f9e28969 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:30.318276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:30.319214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:30.319503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:30.319785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] PATH_INFO: `/v3/projects/792c0de65583451a9989830333475276` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:30.321045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] RBAC: Authorizing `identity:delete_project(project_id=792c0de65583451a9989830333475276)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:30.323022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:30.438277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792c0de65583451a9989830333475276', 'request_id': 'req-4e1f9b84-a43b-49ed-83bd-18efc933e759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:30.444366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792c0de65583451a9989830333475276', 'request_id': 'req-4e1f9b84-a43b-49ed-83bd-18efc933e759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:30.551625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792c0de65583451a9989830333475276', 'request_id': 'req-4e1f9b84-a43b-49ed-83bd-18efc933e759'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:30.566686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] The token cache is being invalidate because project 792c0de65583451a9989830333475276 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:29:30.567182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:30.568259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4e1f9b84-a43b-49ed-83bd-18efc933e759 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:30.571718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1168/2339] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:29:30 2022] DELETE /identity/v3/projects/792c0de65583451a9989830333475276 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:29:30.578528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074308-8a7b-44c9-b501-3d0717462fb7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:30.579117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074308-8a7b-44c9-b501-3d0717462fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:30.579621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074308-8a7b-44c9-b501-3d0717462fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:30.605757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a6074308-8a7b-44c9-b501-3d0717462fb7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:30.607924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a6074308-8a7b-44c9-b501-3d0717462fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:30.695443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1172/2340] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:30.704729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da71cb-ca5e-4665-b6d2-a76ffb68075f None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:30.705660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da71cb-ca5e-4665-b6d2-a76ffb68075f None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:30.706161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da71cb-ca5e-4665-b6d2-a76ffb68075f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:30.734907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-70da71cb-ca5e-4665-b6d2-a76ffb68075f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:30.743639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70da71cb-ca5e-4665-b6d2-a76ffb68075f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:30.753104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1169/2341] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:30.758181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074308-8a7b-44c9-b501-3d0717462fb7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:30.773804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074308-8a7b-44c9-b501-3d0717462fb7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:30.780378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:30.780562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:30.780759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:30.781101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:30.782920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:29:30.782920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:30.783780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:30.797575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1173/2342] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:29:30.802046 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da71cb-ca5e-4665-b6d2-a76ffb68075f None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:30.814599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da71cb-ca5e-4665-b6d2-a76ffb68075f None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:30.825380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:30.826095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:30.826369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:30.826648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:30.827372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:30.829374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:30.955113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1170/2343] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:29:30 2022] POST /identity/v3/projects => generated 389 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:29:30.959539 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:30.971023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938c483-a5af-4e82-8749-ff53f92ce317 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:31.035935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:31.036613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:31.036896 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:31.037202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:31.037911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:31.039858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:31.048216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:31.197366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1174/2344] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:29:30 2022] POST /identity/v3/users => generated 295 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:29:31.201792 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:31.212969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc0e9a-759d-40c1-b89f-6ddea24652b8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:31.219255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:31.219931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:31.220219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:31.220503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:31.221270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:31.222899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:31.240823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1171/2345] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:29:31.244555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:31.255749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d956fc5-fb49-4ea2-89ae-4d231028983e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:31.260696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98788c3f-48e1-4c4c-827d-015f2878d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:31.262175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98788c3f-48e1-4c4c-827d-015f2878d2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:31.262468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98788c3f-48e1-4c4c-827d-015f2878d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:31.262752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98788c3f-48e1-4c4c-827d-015f2878d2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:31.263507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98788c3f-48e1-4c4c-827d-015f2878d2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:31.265256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98788c3f-48e1-4c4c-827d-015f2878d2f1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:31.277940 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1175/2346] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:29:31.284527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:31.301460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95deb37-b94c-4f91-9308-6c8ab27c74ad admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:31.309182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:31.310683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:31.311171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:31.311684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] PATH_INFO: `/v3/projects/9ab3758f29fa4bd9b74b00912a059748/users/d6a27a493f424ce795cf740cc8b645db/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:31.332131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ab3758f29fa4bd9b74b00912a059748, user_id=d6a27a493f424ce795cf740cc8b645db, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:31.334900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:31.454631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1172/2347] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:29:31 2022] PUT /identity/v3/projects/9ab3758f29fa4bd9b74b00912a059748/users/d6a27a493f424ce795cf740cc8b645db/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:29:31.467000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5bc6d-acd0-4fbb-8251-3afda3d47893 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:31.467443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5bc6d-acd0-4fbb-8251-3afda3d47893 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:31.467962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d5bc6d-acd0-4fbb-8251-3afda3d47893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:31.505889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a7d5bc6d-acd0-4fbb-8251-3afda3d47893 None None] MFA Rules not processed for user `d6a27a493f424ce795cf740cc8b645db`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:31.507146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a7d5bc6d-acd0-4fbb-8251-3afda3d47893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:31.579880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1176/2348] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:31.591426 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:31.593292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:31.635228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:31.669165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1d0a5-1522-4939-8076-a62fde2c6a4b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:31.673412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018351a-713f-4912-93e7-f83681df1a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:31.674080 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018351a-713f-4912-93e7-f83681df1a70 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:31.674364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018351a-713f-4912-93e7-f83681df1a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:31.674640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018351a-713f-4912-93e7-f83681df1a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:31.684869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018351a-713f-4912-93e7-f83681df1a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:31.686376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018351a-713f-4912-93e7-f83681df1a70 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:31.696433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1173/2349] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:29:41.576574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:41.871082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=14 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:44.332166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5bc6d-acd0-4fbb-8251-3afda3d47893 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:44.503349 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d5bc6d-acd0-4fbb-8251-3afda3d47893 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:44.509847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:44.511502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:44.511901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:44.512286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] PATH_INFO: `/v3/users/d6a27a493f424ce795cf740cc8b645db` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:44.513938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a27a493f424ce795cf740cc8b645db)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:44.516018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:44.766174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a27a493f424ce795cf740cc8b645db'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:44.781683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a27a493f424ce795cf740cc8b645db'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:44.790301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a27a493f424ce795cf740cc8b645db'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:44.871956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a27a493f424ce795cf740cc8b645db'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:44.872589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a27a493f424ce795cf740cc8b645db'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:44.879608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1177/2350] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:29:44 2022] DELETE /identity/v3/users/d6a27a493f424ce795cf740cc8b645db => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:29:44.884374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:44.884883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:44.885030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:44.908343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:44.909677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:44.982054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1174/2351] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:29:44.995539 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:44.997102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:45.067647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a23ad8-098f-40b4-b189-47f7ee372bec admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:45.075344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:45.076111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:45.076472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:45.076817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:45.087755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:45.089962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:45.100405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1178/2352] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:29:45.569940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:45.571327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:45.584102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52480de3-a1e4-4ca3-8a7d-85e483cb11bf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:45.589706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:45.590648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:45.590888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:45.591188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] PATH_INFO: `/v3/projects/9ab3758f29fa4bd9b74b00912a059748` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:45.592467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ab3758f29fa4bd9b74b00912a059748)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:45.594537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:45.732249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ab3758f29fa4bd9b74b00912a059748', 'request_id': 'req-a40a7ae0-37aa-4e7c-9223-75268f567eb2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:45.740112 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ab3758f29fa4bd9b74b00912a059748', 'request_id': 'req-a40a7ae0-37aa-4e7c-9223-75268f567eb2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:45.819714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ab3758f29fa4bd9b74b00912a059748', 'request_id': 'req-a40a7ae0-37aa-4e7c-9223-75268f567eb2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:45.833245 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] The token cache is being invalidate because project 9ab3758f29fa4bd9b74b00912a059748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:29:45.833465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:45.834108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:45.835704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1175/2353] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:29:45 2022] DELETE /identity/v3/projects/9ab3758f29fa4bd9b74b00912a059748 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:29:52.809469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:52.811072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:52.839796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:52.890852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5818a1-388d-4fc5-87c5-38137f8d938e service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:52.955170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b33f46-5c77-4dff-930a-c2c06883b7ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:52.955837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b33f46-5c77-4dff-930a-c2c06883b7ae service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:52.956131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b33f46-5c77-4dff-930a-c2c06883b7ae service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:52.956404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b33f46-5c77-4dff-930a-c2c06883b7ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:52.961816 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-85b33f46-5c77-4dff-930a-c2c06883b7ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:53.022350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b33f46-5c77-4dff-930a-c2c06883b7ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:53.023958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b33f46-5c77-4dff-930a-c2c06883b7ae service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:53.033684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1179/2354] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:29:53.078379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:53.079830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:53.142874 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a7ae0-37aa-4e7c-9223-75268f567eb2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:53.146749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35492c1-0c0c-47ca-aa23-ba9b1f61e00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:53.147406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35492c1-0c0c-47ca-aa23-ba9b1f61e00e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:53.147692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35492c1-0c0c-47ca-aa23-ba9b1f61e00e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:53.147969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35492c1-0c0c-47ca-aa23-ba9b1f61e00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:53.149890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e35492c1-0c0c-47ca-aa23-ba9b1f61e00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:53.189073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:53.215864 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35492c1-0c0c-47ca-aa23-ba9b1f61e00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:53.217482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35492c1-0c0c-47ca-aa23-ba9b1f61e00e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:53.231615 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1176/2355] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:29:55.319697 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:55.320218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:55.320372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:55.339931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] MFA Rules not processed for user `6b6c6957d1d54119bbb240a4bfda4b31`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:55.344470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.406369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1180/2356] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:55.410460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:55.410967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:55.411097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:55.429630 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] MFA Rules not processed for user `4b57f9679e65450b9d97b0ce893fd6bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:55.430859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.443116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:55.444663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.450675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:55.498824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1177/2357] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:55.512065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:55.514275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.515835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89601baa-f2cd-4bf5-bb8d-937b9b252016 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:55.523420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:55.524738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:55.524738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:55.525022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:55.527444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.534462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140216d9-63f9-4f80-95e1-67aef7ce1a9d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:55.543571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e6adc-15a4-4fcd-a5fa-0496e7c5241c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:55.543911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:55.544338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e6adc-15a4-4fcd-a5fa-0496e7c5241c service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:55.544632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e6adc-15a4-4fcd-a5fa-0496e7c5241c service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:55.544917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e6adc-15a4-4fcd-a5fa-0496e7c5241c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:55.545844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:55.546927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ab7e6adc-15a4-4fcd-a5fa-0496e7c5241c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.559179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e6adc-15a4-4fcd-a5fa-0496e7c5241c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:55.560911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e6adc-15a4-4fcd-a5fa-0496e7c5241c service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:55.566182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1181/2358] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:29:55.572432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1178/2359] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:29:55.897230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:55.899999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.913404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963b39c-825c-4ab2-acdd-b1a3d9953618 service glance] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:55.923714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684639da-0061-4bae-9945-3361423b105f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:55.924412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684639da-0061-4bae-9945-3361423b105f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:55.924696 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684639da-0061-4bae-9945-3361423b105f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:55.924970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684639da-0061-4bae-9945-3361423b105f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:55.926837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-684639da-0061-4bae-9945-3361423b105f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:55.939277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684639da-0061-4bae-9945-3361423b105f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:55.941351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684639da-0061-4bae-9945-3361423b105f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:55.956880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1182/2360] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:29:58.595191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed85d7-aaa2-4aba-a934-f9f2a7149b67 None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:58.595729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed85d7-aaa2-4aba-a934-f9f2a7149b67 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:58.595729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed85d7-aaa2-4aba-a934-f9f2a7149b67 None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:58.597394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1179/2361] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 06:29:58.607435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:58.613000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:58.613000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:58.627474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] MFA Rules not processed for user `5cb84c685c4840a8958ff1a82f2b6f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:58.628941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:58.695543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1183/2362] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:29:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:58.710737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed85d7-aaa2-4aba-a934-f9f2a7149b67 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:58.710737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-99ed85d7-aaa2-4aba-a934-f9f2a7149b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:58.734657 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed85d7-aaa2-4aba-a934-f9f2a7149b67 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:58.740188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:58.741406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:58.741922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:58.742667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:58.754321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:58.756270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:58.773736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1180/2363] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:29:58.823464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:58.825137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:58.840233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cade66-ea74-429e-a8f6-a105b29e0b67 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:58.844872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:58.845911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:58.846196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:58.846472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] PATH_INFO: `/v3/users/1c4e450af95547bc9c633612b110858e` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:58.847851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4e450af95547bc9c633612b110858e)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:58.849933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:59.048280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4e450af95547bc9c633612b110858e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.067592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4e450af95547bc9c633612b110858e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.078430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4e450af95547bc9c633612b110858e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.154336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4e450af95547bc9c633612b110858e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.155001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-fa855939-d818-43d7-9131-8e6eb0e374fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4e450af95547bc9c633612b110858e'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.157469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:59.165514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1184/2364] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:29:58 2022] DELETE /identity/v3/users/1c4e450af95547bc9c633612b110858e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:29:59.444770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:59.457752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e74b0-5aca-41ad-988c-3b0c124d23ec service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:59.535685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:59.536554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:59.536842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:59.537151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] PATH_INFO: `/v3/projects/722e4100a04e4b7c877eedb6b2d8c670` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:59.538457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=722e4100a04e4b7c877eedb6b2d8c670)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:59.540443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:59.655820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722e4100a04e4b7c877eedb6b2d8c670', 'request_id': 'req-75a7fe83-4290-479f-b19d-04adf8049cce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.659753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:29:59.661915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722e4100a04e4b7c877eedb6b2d8c670', 'request_id': 'req-75a7fe83-4290-479f-b19d-04adf8049cce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.711149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722e4100a04e4b7c877eedb6b2d8c670', 'request_id': 'req-75a7fe83-4290-479f-b19d-04adf8049cce'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.724691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] The token cache is being invalidate because project 722e4100a04e4b7c877eedb6b2d8c670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:29:59.725072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.725678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:29:59.727510 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1181/2365] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:29:59 2022] DELETE /identity/v3/projects/722e4100a04e4b7c877eedb6b2d8c670 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:29:59.732536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5918-8e2c-4c53-8ad4-7d46062709a8 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:59.733088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5918-8e2c-4c53-8ad4-7d46062709a8 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:59.733088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f5918-8e2c-4c53-8ad4-7d46062709a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:59.753794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6b0f5918-8e2c-4c53-8ad4-7d46062709a8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:59.756444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b0f5918-8e2c-4c53-8ad4-7d46062709a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:59.831281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:59.832721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:59.841974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1185/2366] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:29:59.854582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756144a1-fce2-4297-9ba9-0c2ef1e3f4d3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:59.855008 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756144a1-fce2-4297-9ba9-0c2ef1e3f4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:59.855673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756144a1-fce2-4297-9ba9-0c2ef1e3f4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:59.876798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-756144a1-fce2-4297-9ba9-0c2ef1e3f4d3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:29:59.878083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-756144a1-fce2-4297-9ba9-0c2ef1e3f4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:59.887986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1186/2367] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:29:59.892609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756144a1-fce2-4297-9ba9-0c2ef1e3f4d3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:59.905017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756144a1-fce2-4297-9ba9-0c2ef1e3f4d3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:59.908309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:59.909005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:59.909308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:59.909589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:59.910330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:29:59.910640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:59.913145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:29:59.921984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7fe83-4290-479f-b19d-04adf8049cce admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:59.928889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1187/2368] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:29:59.935015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:29:59.935169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:59.935857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:59.936143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:59.936422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:59.938447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:29:59.949255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca62304-9d62-4bdb-9a8d-31f26168f86d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:29:59.954668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:29:59.956088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:29:59.956442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:29:59.956903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:29:59.957661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:29:59.959817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:00.044072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:00.045716 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:00.058519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1182/2369] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:29:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:30:00.116213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1188/2370] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:29:59 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:00.121054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:00.131589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb8570-8a8e-4c83-af02-611cc874fe06 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:00.193427 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:00.194151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:00.194463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:00.194877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:00.195583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:00.197757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:00.279391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1183/2371] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:00 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:00.283554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:00.318690 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792b03e5-f5df-477c-a58a-5820c4ad52c1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:00.325138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:00.326124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:00.326451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:00.326753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:00.327446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:00.329158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:00.343675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1189/2372] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:00.348334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:00.360569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d6db9-9254-4812-a181-d6bc5dc3eb6d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:00.365668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f88b94-9582-421b-adbb-85d75f27769a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:00.366253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f88b94-9582-421b-adbb-85d75f27769a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:00.366532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f88b94-9582-421b-adbb-85d75f27769a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:00.366773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f88b94-9582-421b-adbb-85d75f27769a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:00.367507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f88b94-9582-421b-adbb-85d75f27769a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:00.369352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f88b94-9582-421b-adbb-85d75f27769a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:00.382663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1184/2373] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:00.387004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:00.398408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c14dce-0297-41bf-90f0-c38328e07766 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:00.403932 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:00.404835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:00.406280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:00.406280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] PATH_INFO: `/v3/projects/f8d2efafcc2e4d589e57a8a1ed1977d1/users/a88b4d570f4e4212bb6780f57daf7022/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:00.422509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d2efafcc2e4d589e57a8a1ed1977d1, user_id=a88b4d570f4e4212bb6780f57daf7022, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:00.425333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:00.539913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1190/2374] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:00 2022] PUT /identity/v3/projects/f8d2efafcc2e4d589e57a8a1ed1977d1/users/a88b4d570f4e4212bb6780f57daf7022/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:00.552316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:00.552559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:00.552849 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:00.559855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:00.594913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] MFA Rules not processed for user `a88b4d570f4e4212bb6780f57daf7022`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:00.599004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:00.710116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1185/2375] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:00.724559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:00.726411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:00.817142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf3f80-4884-4ec5-ba5d-34beb941c3ce admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:00.826047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:00.826047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:00.826047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:00.826047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:00.833064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:00.835651 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:00.846388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1191/2376] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:01.984097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:01.985784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:02.006551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ac72aa-8ab2-4cef-8b20-e197c24c1d12 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:02.013811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4c43d-39cd-43eb-919a-8ba36ba83a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:02.014559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4c43d-39cd-43eb-919a-8ba36ba83a31 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:02.014921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4c43d-39cd-43eb-919a-8ba36ba83a31 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:02.015271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4c43d-39cd-43eb-919a-8ba36ba83a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:02.017158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-46a4c43d-39cd-43eb-919a-8ba36ba83a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:02.114297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4c43d-39cd-43eb-919a-8ba36ba83a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:02.116104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4c43d-39cd-43eb-919a-8ba36ba83a31 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:02.132616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1186/2377] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:04.152426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:04.161536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:04.219460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b8cc9-3273-4906-98ca-b6cf9d9d474c service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:04.224011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:04.225187 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:04.225654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:04.226391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] PATH_INFO: `/v3/users/a88b4d570f4e4212bb6780f57daf7022` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:04.227689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88b4d570f4e4212bb6780f57daf7022)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:04.229954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:04.439623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88b4d570f4e4212bb6780f57daf7022'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:04.452585 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88b4d570f4e4212bb6780f57daf7022'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:04.459898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88b4d570f4e4212bb6780f57daf7022'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:04.567784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88b4d570f4e4212bb6780f57daf7022'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:04.568460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88b4d570f4e4212bb6780f57daf7022'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:04.575856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1192/2378] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:04 2022] DELETE /identity/v3/users/a88b4d570f4e4212bb6780f57daf7022 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:04.580678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:04.581180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:04.581262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:04.598872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:04.600095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:04.669973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1187/2379] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:04.680534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:04.682111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:04.773722 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16630351-d0ca-4301-b4e2-d133e1570795 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:04.778966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da739eed-525e-4d23-891e-53104ee8bd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:04.780733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739eed-525e-4d23-891e-53104ee8bd72 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:04.780733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739eed-525e-4d23-891e-53104ee8bd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:04.780733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da739eed-525e-4d23-891e-53104ee8bd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:04.791030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da739eed-525e-4d23-891e-53104ee8bd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:04.793189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da739eed-525e-4d23-891e-53104ee8bd72 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:04.804450 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1193/2380] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:05.472326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:05.473859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:05.490295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691609a0-b1a1-41dd-8e72-3815c30828cd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:05.497221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:05.498473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:05.498676 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:05.498926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] PATH_INFO: `/v3/projects/f8d2efafcc2e4d589e57a8a1ed1977d1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:05.502581 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d2efafcc2e4d589e57a8a1ed1977d1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:05.505800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:05.643880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:05.662082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d2efafcc2e4d589e57a8a1ed1977d1', 'request_id': 'req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:05.668278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d2efafcc2e4d589e57a8a1ed1977d1', 'request_id': 'req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:05.750435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d2efafcc2e4d589e57a8a1ed1977d1', 'request_id': 'req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:05.766721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] The token cache is being invalidate because project f8d2efafcc2e4d589e57a8a1ed1977d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:05.767109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:05.767899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-15f64b8c-d4dd-4e2b-b756-60df0fdc6c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:05.769930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1188/2381] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:05 2022] DELETE /identity/v3/projects/f8d2efafcc2e4d589e57a8a1ed1977d1 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:05.775339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ce43-58b6-4b72-ba7f-874488c23478 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:05.775931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ce43-58b6-4b72-ba7f-874488c23478 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:05.775931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9ce43-58b6-4b72-ba7f-874488c23478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:05.800692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1df9ce43-58b6-4b72-ba7f-874488c23478 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:05.802006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1df9ce43-58b6-4b72-ba7f-874488c23478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:05.837003 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:05.878240 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1194/2382] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:05.886260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b960-2db0-4c40-b2f8-6b03484e6598 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:05.886649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b960-2db0-4c40-b2f8-6b03484e6598 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:05.886951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b9b960-2db0-4c40-b2f8-6b03484e6598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:05.907157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e4b9b960-2db0-4c40-b2f8-6b03484e6598 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:05.908379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e4b9b960-2db0-4c40-b2f8-6b03484e6598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:05.916852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1189/2383] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:05.922318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9ce43-58b6-4b72-ba7f-874488c23478 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:05.936961 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9ce43-58b6-4b72-ba7f-874488c23478 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:05.942460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:05.943148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:05.943438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:05.943723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:05.944483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:30:05.944792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:05.946561 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:05.967248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1195/2384] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:30:05.971736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9b960-2db0-4c40-b2f8-6b03484e6598 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:05.978540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b9b960-2db0-4c40-b2f8-6b03484e6598 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:05.985051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:05.985735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:05.986025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:05.986301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:05.987011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:05.989233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:06.138320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1190/2385] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:05 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:06.139727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:06.153882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d51801f-7ba8-4559-85e4-55e1e88bbc17 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:06.218587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:06.219277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:06.219556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:06.219832 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:06.220540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:06.222495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:06.346663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1196/2386] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:06 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:06.353583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:06.365512 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd72f272-8e20-41c4-8bd9-9d5ce9548e9e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:06.370280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:06.371182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:06.371476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:06.371759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:06.372503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:06.374186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:06.386097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1191/2387] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:06.399117 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:06.413603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394f430-5c71-4a86-91bd-1a2bd81d1219 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:06.421869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a30fa0-706d-4c94-bbc0-323cc8e6d957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:06.422805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30fa0-706d-4c94-bbc0-323cc8e6d957 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:06.423215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30fa0-706d-4c94-bbc0-323cc8e6d957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:06.424155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a30fa0-706d-4c94-bbc0-323cc8e6d957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:06.424903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a30fa0-706d-4c94-bbc0-323cc8e6d957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:06.428307 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a30fa0-706d-4c94-bbc0-323cc8e6d957 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:06.442823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1197/2388] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:06.447642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:06.459011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d51f3-468e-49bb-883a-6753014ce46a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:06.465494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:06.466410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:06.466693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:06.466972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] PATH_INFO: `/v3/projects/f352bdb76f9747b79b605be3e1edee73/users/b93c10fc66bd4259af8f19660a89bdf7/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:06.499902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f352bdb76f9747b79b605be3e1edee73, user_id=b93c10fc66bd4259af8f19660a89bdf7, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:06.503284 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:06.649529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1192/2389] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:06 2022] PUT /identity/v3/projects/f352bdb76f9747b79b605be3e1edee73/users/b93c10fc66bd4259af8f19660a89bdf7/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:06.664312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393bd05-7081-4c48-b524-f193fa73a82e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:06.664606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393bd05-7081-4c48-b524-f193fa73a82e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:06.664889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393bd05-7081-4c48-b524-f193fa73a82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:06.699882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f393bd05-7081-4c48-b524-f193fa73a82e None None] MFA Rules not processed for user `b93c10fc66bd4259af8f19660a89bdf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:06.701207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f393bd05-7081-4c48-b524-f193fa73a82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:06.774285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1198/2390] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:06.789141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:06.791916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:06.926818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89def277-0e1c-4bb9-a6e9-fde0241d98d4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:06.934067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:06.934760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:06.935180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:06.935559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:06.946376 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:06.947992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:06.958339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1193/2391] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:07.237745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393bd05-7081-4c48-b524-f193fa73a82e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:07.276936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:07.319203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393bd05-7081-4c48-b524-f193fa73a82e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:07.332033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:07.333014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:07.334183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:07.334183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] PATH_INFO: `/v3/users/b93c10fc66bd4259af8f19660a89bdf7` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:07.337644 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93c10fc66bd4259af8f19660a89bdf7)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:07.344740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:07.585858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:07.593834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:07.611417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93c10fc66bd4259af8f19660a89bdf7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:07.644059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:07.653013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93c10fc66bd4259af8f19660a89bdf7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:07.668414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff428d-2d28-410b-adf6-10aee15fa83e service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:07.672256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93c10fc66bd4259af8f19660a89bdf7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:07.674842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edc217-418e-4f58-8cc3-e4dfbc39a84f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:07.675804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc217-418e-4f58-8cc3-e4dfbc39a84f service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:07.676182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc217-418e-4f58-8cc3-e4dfbc39a84f service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:07.676692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edc217-418e-4f58-8cc3-e4dfbc39a84f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:07.679373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e4edc217-418e-4f58-8cc3-e4dfbc39a84f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:07.692217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edc217-418e-4f58-8cc3-e4dfbc39a84f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:07.693936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4edc217-418e-4f58-8cc3-e4dfbc39a84f service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:07.704178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1194/2392] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:07.820831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93c10fc66bd4259af8f19660a89bdf7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:07.821729 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93c10fc66bd4259af8f19660a89bdf7'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:07.833215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1199/2393] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:07 2022] DELETE /identity/v3/users/b93c10fc66bd4259af8f19660a89bdf7 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:07.838364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:07.839363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:07.839789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:07.869644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:07.877357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:07.964960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1195/2394] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:07.975254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:07.977062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:08.038183 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d3911-50df-437d-b822-0f2a48aa20d4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:08.042423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0346a-a5e3-4cf9-b4b2-3c916d2e310a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:08.043103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0346a-a5e3-4cf9-b4b2-3c916d2e310a service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:08.043416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0346a-a5e3-4cf9-b4b2-3c916d2e310a service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:08.043694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0346a-a5e3-4cf9-b4b2-3c916d2e310a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:08.053977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0346a-a5e3-4cf9-b4b2-3c916d2e310a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:08.055415 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0346a-a5e3-4cf9-b4b2-3c916d2e310a service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:08.065407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1200/2395] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:08.520170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:08.523359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:08.551536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fed5f7-8c4d-48a3-a04d-a398258d36ec None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:08.566985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:08.567882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:08.568188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:08.568456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] PATH_INFO: `/v3/projects/f352bdb76f9747b79b605be3e1edee73` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:08.570041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f352bdb76f9747b79b605be3e1edee73)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:08.573108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:08.725452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f352bdb76f9747b79b605be3e1edee73', 'request_id': 'req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:08.732485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f352bdb76f9747b79b605be3e1edee73', 'request_id': 'req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:08.785407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f352bdb76f9747b79b605be3e1edee73', 'request_id': 'req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:08.797643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] The token cache is being invalidate because project f352bdb76f9747b79b605be3e1edee73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:08.797927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:08.798594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3519cc10-4c6c-4c52-9ed6-3de74a7a024a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:08.800177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1196/2396] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:08 2022] DELETE /identity/v3/projects/f352bdb76f9747b79b605be3e1edee73 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:08.805404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6be3-e4f6-4c8b-a74b-c527691a8268 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:08.805975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6be3-e4f6-4c8b-a74b-c527691a8268 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:08.805975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bd6be3-e4f6-4c8b-a74b-c527691a8268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:08.826419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-69bd6be3-e4f6-4c8b-a74b-c527691a8268 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:08.827426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-69bd6be3-e4f6-4c8b-a74b-c527691a8268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:08.874864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:08.892315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1201/2397] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:08.901796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce4d1-620c-4722-b1da-6e86c6609198 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:08.902092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce4d1-620c-4722-b1da-6e86c6609198 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:08.902378 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ce4d1-620c-4722-b1da-6e86c6609198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:08.921718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dc0ce4d1-620c-4722-b1da-6e86c6609198 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:08.922985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc0ce4d1-620c-4722-b1da-6e86c6609198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:08.931802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1197/2398] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:30:08.936327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6be3-e4f6-4c8b-a74b-c527691a8268 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:08.946313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bd6be3-e4f6-4c8b-a74b-c527691a8268 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:08.951828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:08.952495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:08.952820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:08.953145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:08.953881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:30:08.954194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:08.962254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:08.970582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1202/2399] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:30:08.975063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce4d1-620c-4722-b1da-6e86c6609198 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:08.985454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ce4d1-620c-4722-b1da-6e86c6609198 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:08.990570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:08.991276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:08.991583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:08.991860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:08.992565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:08.994584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:09.079569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1198/2400] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:08 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:09.083810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:09.103946 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b13ee-8b71-40ef-9099-0f828d30eba8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:09.162510 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:09.163177 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:09.163455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:09.163738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:09.164446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:09.166387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:09.276972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1203/2401] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:09 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:09.281238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:09.297164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4e9df-917e-4f7d-99d5-da4fad5f374d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:09.298696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:09.299451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:09.299736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:09.300064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:09.300927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:09.302592 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:09.316575 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1199/2402] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:09.320812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:09.333171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6672112-fd60-4ecc-96ca-df44a0d40b78 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:09.338105 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3871025-6c32-4c6a-9c9a-80afa9387c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:09.339477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871025-6c32-4c6a-9c9a-80afa9387c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:09.339477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871025-6c32-4c6a-9c9a-80afa9387c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:09.339477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3871025-6c32-4c6a-9c9a-80afa9387c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:09.340154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3871025-6c32-4c6a-9c9a-80afa9387c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:09.342035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3871025-6c32-4c6a-9c9a-80afa9387c47 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:09.352740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1204/2403] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:09.357034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:09.367604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd5034f-2067-4ef3-b5ea-59132a4da532 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:09.372783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:09.373701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:09.373986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:09.374262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] PATH_INFO: `/v3/projects/729498f15d554c9d9fa485657effb404/users/dcba00c7cf204aa4a3ebe4e870212da3/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:09.390658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=729498f15d554c9d9fa485657effb404, user_id=dcba00c7cf204aa4a3ebe4e870212da3, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:09.393453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:09.500387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1200/2404] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:09 2022] PUT /identity/v3/projects/729498f15d554c9d9fa485657effb404/users/dcba00c7cf204aa4a3ebe4e870212da3/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:09.505336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db585-81f4-4b90-a244-777e443b0e67 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:09.505666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db585-81f4-4b90-a244-777e443b0e67 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:09.505995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db585-81f4-4b90-a244-777e443b0e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:09.524771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3c2db585-81f4-4b90-a244-777e443b0e67 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:09.526233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3c2db585-81f4-4b90-a244-777e443b0e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:09.594655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1205/2405] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:09.604742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:09.607451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:09.683970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af322753-a2ce-45bc-be5f-e8107157fbbd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:09.689767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:09.690437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:09.690731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:09.691182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:09.701707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:09.703032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:09.719492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1201/2406] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:09.894553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:11.529351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa745-cfa7-4a9c-a52b-0c1ba77cc36f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:11.530469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa745-cfa7-4a9c-a52b-0c1ba77cc36f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:11.531433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa745-cfa7-4a9c-a52b-0c1ba77cc36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:11.571681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-d74aa745-cfa7-4a9c-a52b-0c1ba77cc36f None None] MFA Rules not processed for user `dcba00c7cf204aa4a3ebe4e870212da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:11.573123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d74aa745-cfa7-4a9c-a52b-0c1ba77cc36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:11.640089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:11.671562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1206/2407] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:11.675701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:11.685899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546571-81f8-4b54-a22c-fc17a77bb315 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:11.691451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:11.692375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:11.692660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:11.692935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:11.698610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:11.698610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:11.792413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1202/2408] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:11 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:11.796135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aa745-cfa7-4a9c-a52b-0c1ba77cc36f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:11.815804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aa745-cfa7-4a9c-a52b-0c1ba77cc36f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:11.912951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:11.920752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:11.920752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:11.920752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:11.920752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:11.921502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:12.034175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1207/2409] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:11 2022] POST /identity/v3/users => generated 309 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:12.038955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:12.052620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c95ed3-585d-4331-b8ca-d3776d284dd6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:12.058145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:12.059223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:12.060117 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:12.060718 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:12.061868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:12.064063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:12.100058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1203/2410] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:12.105509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:12.125224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a5ea6-34c6-497a-8d66-0fe1ed2ed964 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:12.132249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:12.133711 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:12.134162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:12.134605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] PATH_INFO: `/v3/projects/9b8203da794c4959bb67e056f9812d2d/users/046b4f29742f4ca5885834f40c1d8dcf/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:12.159109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8203da794c4959bb67e056f9812d2d, user_id=046b4f29742f4ca5885834f40c1d8dcf, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:12.162397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:12.242399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1208/2411] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:12 2022] PUT /identity/v3/projects/9b8203da794c4959bb67e056f9812d2d/users/046b4f29742f4ca5885834f40c1d8dcf/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:12.247362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:12.262185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd3933-11e7-4b34-b607-c558d383b00b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:12.339007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63748be7-4c99-4223-84e6-0b3c828ec376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:12.339875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748be7-4c99-4223-84e6-0b3c828ec376 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:12.340269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748be7-4c99-4223-84e6-0b3c828ec376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:12.340663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63748be7-4c99-4223-84e6-0b3c828ec376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:12.341573 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748be7-4c99-4223-84e6-0b3c828ec376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:12.343406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63748be7-4c99-4223-84e6-0b3c828ec376 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:12.355528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1204/2412] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:12.359674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:12.390192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc59bc-cae3-433a-9438-ca04a88a0c5f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:12.395423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:12.397137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:12.397501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:12.397853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] PATH_INFO: `/v3/projects/9b8203da794c4959bb67e056f9812d2d/users/046b4f29742f4ca5885834f40c1d8dcf/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:12.400372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8203da794c4959bb67e056f9812d2d, user_id=046b4f29742f4ca5885834f40c1d8dcf, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:12.403769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:12.430999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1209/2413] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:12 2022] PUT /identity/v3/projects/9b8203da794c4959bb67e056f9812d2d/users/046b4f29742f4ca5885834f40c1d8dcf/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:14.151067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f99ea-be84-4e5b-9cc0-f82071aa09c5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:14.151619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f99ea-be84-4e5b-9cc0-f82071aa09c5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:14.151619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f99ea-be84-4e5b-9cc0-f82071aa09c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:14.186871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f74f99ea-be84-4e5b-9cc0-f82071aa09c5 None None] MFA Rules not processed for user `046b4f29742f4ca5885834f40c1d8dcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:14.188248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f74f99ea-be84-4e5b-9cc0-f82071aa09c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:14.273504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:14.305298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1205/2414] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:14 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:15.889725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:15.968494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68e66e5-e24a-42bc-8d97-9eef29b9d7d0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:15.977714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:15.978610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:15.978901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:15.984303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] PATH_INFO: `/v3/users/dcba00c7cf204aa4a3ebe4e870212da3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:15.984303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcba00c7cf204aa4a3ebe4e870212da3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:15.984303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:16.194189 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:16.200576 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcba00c7cf204aa4a3ebe4e870212da3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.212874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcba00c7cf204aa4a3ebe4e870212da3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.221665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcba00c7cf204aa4a3ebe4e870212da3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.311196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcba00c7cf204aa4a3ebe4e870212da3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.311823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcba00c7cf204aa4a3ebe4e870212da3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.318625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1210/2415] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:15 2022] DELETE /identity/v3/users/dcba00c7cf204aa4a3ebe4e870212da3 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:16.622219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f99ea-be84-4e5b-9cc0-f82071aa09c5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:16.634614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f99ea-be84-4e5b-9cc0-f82071aa09c5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:16.704683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:16.705514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:16.705807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:16.706088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] PATH_INFO: `/v3/projects/729498f15d554c9d9fa485657effb404` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:16.707319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729498f15d554c9d9fa485657effb404)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:16.709307 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:16.810417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729498f15d554c9d9fa485657effb404', 'request_id': 'req-4a8b760d-efa3-4523-b6cd-d3d022fa4012'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.817694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729498f15d554c9d9fa485657effb404', 'request_id': 'req-4a8b760d-efa3-4523-b6cd-d3d022fa4012'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.899308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729498f15d554c9d9fa485657effb404', 'request_id': 'req-4a8b760d-efa3-4523-b6cd-d3d022fa4012'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.914523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] The token cache is being invalidate because project 729498f15d554c9d9fa485657effb404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:16.914831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.915539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:16.917211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1206/2416] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:16 2022] DELETE /identity/v3/projects/729498f15d554c9d9fa485657effb404 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:16.922395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:16.923917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:16.942985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86857783-8e66-4e94-a845-18ed2fcb7de0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:17.013497 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:17.014581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:17.014901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:17.015272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] PATH_INFO: `/v3/users/046b4f29742f4ca5885834f40c1d8dcf` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:17.017397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=046b4f29742f4ca5885834f40c1d8dcf)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:17.021331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:17.249141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '046b4f29742f4ca5885834f40c1d8dcf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:17.264095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '046b4f29742f4ca5885834f40c1d8dcf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:17.272230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '046b4f29742f4ca5885834f40c1d8dcf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:17.346601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '046b4f29742f4ca5885834f40c1d8dcf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:17.346601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a98162f7-4015-4cb0-9c68-8a6546ba0519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '046b4f29742f4ca5885834f40c1d8dcf'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:17.352845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1211/2417] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:16 2022] DELETE /identity/v3/users/046b4f29742f4ca5885834f40c1d8dcf => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:17.679499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:17.682508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:17.705011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8b760d-efa3-4523-b6cd-d3d022fa4012 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:17.794963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:17.796286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:17.796700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:17.797216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] PATH_INFO: `/v3/projects/9b8203da794c4959bb67e056f9812d2d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:17.799325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8203da794c4959bb67e056f9812d2d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:17.802890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:17.834951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:17.987024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8203da794c4959bb67e056f9812d2d', 'request_id': 'req-188c1217-0336-4319-801d-d99c2ab81cea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:17.997711 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8203da794c4959bb67e056f9812d2d', 'request_id': 'req-188c1217-0336-4319-801d-d99c2ab81cea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:18.082480 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8203da794c4959bb67e056f9812d2d', 'request_id': 'req-188c1217-0336-4319-801d-d99c2ab81cea'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:18.097539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] The token cache is being invalidate because project 9b8203da794c4959bb67e056f9812d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:18.098044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:18.098766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-188c1217-0336-4319-801d-d99c2ab81cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:18.100714 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1207/2418] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:17 2022] DELETE /identity/v3/projects/9b8203da794c4959bb67e056f9812d2d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:18.107147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156513e-3306-4178-8177-aa32ed2810a4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.107685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156513e-3306-4178-8177-aa32ed2810a4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.107778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156513e-3306-4178-8177-aa32ed2810a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.128654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9156513e-3306-4178-8177-aa32ed2810a4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:18.130159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9156513e-3306-4178-8177-aa32ed2810a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:18.167247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:18.206302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1212/2419] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:18.218495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e637f-acf8-4212-a894-90af9382063c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.218961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e637f-acf8-4212-a894-90af9382063c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.219298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e637f-acf8-4212-a894-90af9382063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.238940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-af2e637f-acf8-4212-a894-90af9382063c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:18.241861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-af2e637f-acf8-4212-a894-90af9382063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:18.250218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1208/2420] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:18.255047 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156513e-3306-4178-8177-aa32ed2810a4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:18.267065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156513e-3306-4178-8177-aa32ed2810a4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:18.272342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:18.273089 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.273636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.273918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.274663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:30:18.274964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:18.276640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:18.294389 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1213/2421] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:30:18.299302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e637f-acf8-4212-a894-90af9382063c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:18.314227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e637f-acf8-4212-a894-90af9382063c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:18.319204 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:18.319878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.320158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.320529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.321334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:18.323197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:18.428895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1209/2422] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:18 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:18.433553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:18.445679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e298e828-37ec-485e-9bce-a7ac1988ce47 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:18.528129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:18.530501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.530501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.530501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.531213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:18.533136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:18.631828 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1214/2423] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:18 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:18.636759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:18.648894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2921d-7a7b-4b07-8a81-d5a29e6e563d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:18.659277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:18.659520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.659757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.660041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.660782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:18.662697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:18.676453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1210/2424] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:18.680897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:18.696145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a341463-fde2-47c0-b9bb-3e72105232a1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:18.702471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced3667-6a46-40ae-9066-b348202a213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:18.703178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3667-6a46-40ae-9066-b348202a213e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.704430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3667-6a46-40ae-9066-b348202a213e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.704430 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3667-6a46-40ae-9066-b348202a213e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.704618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced3667-6a46-40ae-9066-b348202a213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:18.706203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced3667-6a46-40ae-9066-b348202a213e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:18.724360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1215/2425] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:18.729385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:18.745599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41839b68-08eb-46ee-b07f-c0133b4ad73d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:18.751757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:18.752665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.752949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.753258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] PATH_INFO: `/v3/projects/2a592328eaf14e58ae509b431e59ef98/users/c696a3d3969c4d8a9d6cc73079f0e710/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.773250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a592328eaf14e58ae509b431e59ef98, user_id=c696a3d3969c4d8a9d6cc73079f0e710, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:18.775985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:18.854364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1211/2426] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:18 2022] PUT /identity/v3/projects/2a592328eaf14e58ae509b431e59ef98/users/c696a3d3969c4d8a9d6cc73079f0e710/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:18.866076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfaa5-4b52-4c72-8b48-07470d51ce2a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:18.866373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfaa5-4b52-4c72-8b48-07470d51ce2a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:18.866656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cabfaa5-4b52-4c72-8b48-07470d51ce2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:18.896072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4cabfaa5-4b52-4c72-8b48-07470d51ce2a None None] MFA Rules not processed for user `c696a3d3969c4d8a9d6cc73079f0e710`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:18.897625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4cabfaa5-4b52-4c72-8b48-07470d51ce2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:18.970404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1216/2427] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:18.974961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:19.043097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514bf13d-8ad5-4182-8764-d6b8ee32fdd4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:19.048691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:19.049417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.049700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.050001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:19.050725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:19.052669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:19.167051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1212/2428] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:18 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:19.172019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabfaa5-4b52-4c72-8b48-07470d51ce2a None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:19.183235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cabfaa5-4b52-4c72-8b48-07470d51ce2a None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:19.217861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:19.247371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:19.248244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.248703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.249066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:19.250128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:19.252181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:19.428468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1217/2429] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:19 2022] POST /identity/v3/users => generated 295 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:19.430546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:19.441357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773948b4-68c8-4215-b7de-793ccfc06999 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:19.446425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:19.447096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.447375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.447647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:19.448458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:19.450701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:19.462367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1213/2430] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:19.467688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:19.478564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b2abc-7157-4ab7-ac77-825b525a008a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:19.484106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:19.484670 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.484954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.485278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] PATH_INFO: `/v3/projects/db1396ee3254404486c248370f4b7861/users/21c2bcf49c0c4469a88f5247cbe8416c/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:19.501715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1396ee3254404486c248370f4b7861, user_id=21c2bcf49c0c4469a88f5247cbe8416c, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:19.504942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:19.608419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1218/2431] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:19 2022] PUT /identity/v3/projects/db1396ee3254404486c248370f4b7861/users/21c2bcf49c0c4469a88f5247cbe8416c/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:19.617281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:19.629463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d48beb-ff1d-4dc5-9471-c067c51f0609 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:19.648333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:19.697669 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89fd51-8cef-46e2-99ce-6c1d3711eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:19.698738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89fd51-8cef-46e2-99ce-6c1d3711eec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.699250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89fd51-8cef-46e2-99ce-6c1d3711eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.701265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89fd51-8cef-46e2-99ce-6c1d3711eec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:19.702645 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89fd51-8cef-46e2-99ce-6c1d3711eec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:19.704962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89fd51-8cef-46e2-99ce-6c1d3711eec6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:19.717025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1214/2432] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:19.720719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:19.732635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120d997-ce77-4c7a-b5b0-abf6719070ee admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:19.737456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:19.738385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.738673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.738952 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] PATH_INFO: `/v3/projects/db1396ee3254404486c248370f4b7861/users/21c2bcf49c0c4469a88f5247cbe8416c/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:19.741009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db1396ee3254404486c248370f4b7861, user_id=21c2bcf49c0c4469a88f5247cbe8416c, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:19.743672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:19.754790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1219/2433] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:19 2022] PUT /identity/v3/projects/db1396ee3254404486c248370f4b7861/users/21c2bcf49c0c4469a88f5247cbe8416c/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:19.767235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.767768 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.767768 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:19.796401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] MFA Rules not processed for user `21c2bcf49c0c4469a88f5247cbe8416c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:19.797670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:19.867943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1215/2434] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:19.888917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:19.890810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:19.952554 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345e618-b43d-4359-9aa6-d6ab300cae71 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:19.956301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:19.956953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:19.957278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:19.957563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:20.018790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:20.020233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:20.032498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1220/2435] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:21.388601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:21.390222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:21.512456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c12d5-bbd1-4245-95e0-f2e39636dd1a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:21.518695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:21.523731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:21.523731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:21.523731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:21.523731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:21.536484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:21.538250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:21.550948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1216/2436] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:30:23.552315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:23.567509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe1bf1e-00f3-4b2b-95c9-5bc0aeb6048e service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:23.573407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:23.574639 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:23.575165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:23.575544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:23.588958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:23.591283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:23.605007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1221/2437] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:23 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:28.626681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:28.628944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:28.680871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:28.712054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc34178c-6bd0-4b34-b922-a9ed913a0078 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:28.716621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:28.717397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:28.717783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:28.718101 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:28.720065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:28.820276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:28.821909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:28.832584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1217/2438] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:32.706204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:32.707836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:32.722992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6e7fac-6f45-4395-b20f-aabf85c00574 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:32.727934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:32.728885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:32.729206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:32.729518 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] PATH_INFO: `/v3/users/e7d1d99f0b074def89c572d944f8469a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:32.731422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d1d99f0b074def89c572d944f8469a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:32.733397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:32.756848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:32.892845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d1d99f0b074def89c572d944f8469a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:32.907583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d1d99f0b074def89c572d944f8469a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:32.914643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d1d99f0b074def89c572d944f8469a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:32.973986 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d1d99f0b074def89c572d944f8469a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:32.974622 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a956c10c-261c-4ee7-abec-2f512d90f9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d1d99f0b074def89c572d944f8469a'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:32.983956 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1222/2439] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:32 2022] DELETE /identity/v3/users/e7d1d99f0b074def89c572d944f8469a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:33.318625 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:33.335992 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352934e9-62af-444d-8df1-4578adaf48ed service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:33.422042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:33.422921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:33.423207 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:33.423487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] PATH_INFO: `/v3/projects/d0c8e5c995c84989bbdf244efe72da2e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:33.424861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0c8e5c995c84989bbdf244efe72da2e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:33.426947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:33.554242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0c8e5c995c84989bbdf244efe72da2e', 'request_id': 'req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:33.561128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0c8e5c995c84989bbdf244efe72da2e', 'request_id': 'req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:33.632329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0c8e5c995c84989bbdf244efe72da2e', 'request_id': 'req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:33.646646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] The token cache is being invalidate because project d0c8e5c995c84989bbdf244efe72da2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:33.646937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:33.647603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-fe721c96-9454-4e54-9e3b-1cb4fc7c117b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:33.649206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1218/2440] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:33 2022] DELETE /identity/v3/projects/d0c8e5c995c84989bbdf244efe72da2e => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:33.654943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a612-75aa-4661-946e-68286688446c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:33.655242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a612-75aa-4661-946e-68286688446c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:33.655526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164a612-75aa-4661-946e-68286688446c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:33.676700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b164a612-75aa-4661-946e-68286688446c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:33.677874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b164a612-75aa-4661-946e-68286688446c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:33.744537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1223/2441] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:33.759683 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24adcd3-b6fe-4e4c-bd55-d3dfd62b58a6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:33.759968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24adcd3-b6fe-4e4c-bd55-d3dfd62b58a6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:33.760270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24adcd3-b6fe-4e4c-bd55-d3dfd62b58a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:33.775753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:33.782415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c24adcd3-b6fe-4e4c-bd55-d3dfd62b58a6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:33.783734 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c24adcd3-b6fe-4e4c-bd55-d3dfd62b58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:33.792201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1219/2442] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:33.797662 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a612-75aa-4661-946e-68286688446c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:33.807798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164a612-75aa-4661-946e-68286688446c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:33.813371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:33.814104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:33.814387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:33.814666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:33.818872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:30:33.818872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:33.818872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:33.834136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1224/2443] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:30:33.835617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24adcd3-b6fe-4e4c-bd55-d3dfd62b58a6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:33.846544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24adcd3-b6fe-4e4c-bd55-d3dfd62b58a6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:33.851477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:33.852212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:33.852538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:33.852926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:33.853652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:33.856106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:33.976357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1220/2444] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:33 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:33.983358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:33.999950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353ba730-7ec9-48d2-9c5b-36bf999c7b1e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:34.065872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:34.066560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:34.066853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:34.067134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:34.067864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:34.069967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:34.175824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1225/2445] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:33 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:34.182742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:34.197005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a527b-cac3-4bfe-a5b9-fb1b9357d9e5 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:34.206832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:34.206832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:34.206832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:34.206832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:34.207343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:34.207343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:34.220039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1221/2446] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:34.224597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:34.236477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541dcffe-8a8f-40a9-ba72-fe345efa4715 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:34.241403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf5f013-541d-4deb-8658-b3df647e9643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:34.242091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f013-541d-4deb-8658-b3df647e9643 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:34.242409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f013-541d-4deb-8658-b3df647e9643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:34.242720 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf5f013-541d-4deb-8658-b3df647e9643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:34.243464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5f013-541d-4deb-8658-b3df647e9643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:34.245274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf5f013-541d-4deb-8658-b3df647e9643 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:34.256931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1226/2447] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:34.261146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:34.276191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d2e71-f6d5-48cf-974d-e9d3ce599a64 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:34.287706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:34.288868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:34.289241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:34.289567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] PATH_INFO: `/v3/projects/19eaa57d89354a2bab08c507f49656ae/users/5f0a4a5f21f44887ac2f77693a764552/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:34.310400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19eaa57d89354a2bab08c507f49656ae, user_id=5f0a4a5f21f44887ac2f77693a764552, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:34.314203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:34.380059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1222/2448] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:34 2022] PUT /identity/v3/projects/19eaa57d89354a2bab08c507f49656ae/users/5f0a4a5f21f44887ac2f77693a764552/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:34.391982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:34.392335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:34.392656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:34.399330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:34.425617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] MFA Rules not processed for user `5f0a4a5f21f44887ac2f77693a764552`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:34.426850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:34.500680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1227/2449] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:34.513085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:34.515041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:34.588690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de62617-2c4b-432e-a2a0-2697589b4c1e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:34.594647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06914b6d-ebbe-412a-818b-3776f3cb3b1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:34.595545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914b6d-ebbe-412a-818b-3776f3cb3b1a service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:34.595923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914b6d-ebbe-412a-818b-3776f3cb3b1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:34.596305 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06914b6d-ebbe-412a-818b-3776f3cb3b1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:34.606738 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06914b6d-ebbe-412a-818b-3776f3cb3b1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:34.608258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06914b6d-ebbe-412a-818b-3776f3cb3b1a service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:34.618771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1223/2450] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:39.163911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:39.165514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:39.244195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f7c84-6012-4511-84e4-50beba133e16 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:39.250901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:39.251780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:39.252065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:39.252346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] PATH_INFO: `/v3/users/c696a3d3969c4d8a9d6cc73079f0e710` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:39.253602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c696a3d3969c4d8a9d6cc73079f0e710)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:39.255569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:39.501006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c696a3d3969c4d8a9d6cc73079f0e710'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:39.515236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c696a3d3969c4d8a9d6cc73079f0e710'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:39.525990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c696a3d3969c4d8a9d6cc73079f0e710'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:39.648797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c696a3d3969c4d8a9d6cc73079f0e710'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:39.649506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c696a3d3969c4d8a9d6cc73079f0e710'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:39.657782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1228/2451] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:39 2022] DELETE /identity/v3/users/c696a3d3969c4d8a9d6cc73079f0e710 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:39.664173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:39.664933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:39.664933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:39.690393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:39.691833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:39.782044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1224/2452] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:30:39.798934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:39.801070 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:39.817521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:39.877381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c3a39-0a2f-438a-8a8c-795d0b1cfa4d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:39.881245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:39.881919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:39.882207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:39.882492 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:39.893190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:39.894671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:39.907333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1229/2453] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:30:40.430368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:40.433823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:40.469484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c4c38e-6f92-4dc4-89bb-b195c8c8bd53 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:40.477662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:40.481505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:40.481505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:40.481505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] PATH_INFO: `/v3/projects/2a592328eaf14e58ae509b431e59ef98` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:40.486687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a592328eaf14e58ae509b431e59ef98)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:40.491374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:40.641236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:40.654406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a592328eaf14e58ae509b431e59ef98', 'request_id': 'req-a5f287e9-9819-4256-9736-ebbf4a63ccf8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:40.662259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a592328eaf14e58ae509b431e59ef98', 'request_id': 'req-a5f287e9-9819-4256-9736-ebbf4a63ccf8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:40.773848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a592328eaf14e58ae509b431e59ef98', 'request_id': 'req-a5f287e9-9819-4256-9736-ebbf4a63ccf8'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:40.787886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] The token cache is being invalidate because project 2a592328eaf14e58ae509b431e59ef98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:40.788476 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:40.789442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:40.791467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1225/2454] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:40 2022] DELETE /identity/v3/projects/2a592328eaf14e58ae509b431e59ef98 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:40.795779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:40.809941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68802e8c-7130-4cd5-9b0e-db1104b6c18d service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:40.900296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:40.901545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:40.901834 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:40.902128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] PATH_INFO: `/v3/users/21c2bcf49c0c4469a88f5247cbe8416c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:40.904215 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=21c2bcf49c0c4469a88f5247cbe8416c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:40.906211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:41.116101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21c2bcf49c0c4469a88f5247cbe8416c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:41.133912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21c2bcf49c0c4469a88f5247cbe8416c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:41.142892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21c2bcf49c0c4469a88f5247cbe8416c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:41.291153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21c2bcf49c0c4469a88f5247cbe8416c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:41.291153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-ee11d211-db41-4d22-84d2-e35316967d5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21c2bcf49c0c4469a88f5247cbe8416c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:41.296867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1230/2455] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:40 2022] DELETE /identity/v3/users/21c2bcf49c0c4469a88f5247cbe8416c => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:41.821830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:41.824270 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:41.839502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f287e9-9819-4256-9736-ebbf4a63ccf8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:41.931917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:41.933169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:41.935115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:41.935115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] PATH_INFO: `/v3/projects/db1396ee3254404486c248370f4b7861` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:41.935115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db1396ee3254404486c248370f4b7861)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:41.937950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:42.099742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db1396ee3254404486c248370f4b7861', 'request_id': 'req-bdac0bfd-26c4-4905-9531-5bf90c65bf99'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:42.106655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db1396ee3254404486c248370f4b7861', 'request_id': 'req-bdac0bfd-26c4-4905-9531-5bf90c65bf99'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:42.185166 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db1396ee3254404486c248370f4b7861', 'request_id': 'req-bdac0bfd-26c4-4905-9531-5bf90c65bf99'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:42.198751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] The token cache is being invalidate because project db1396ee3254404486c248370f4b7861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:42.199042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:42.199703 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bdac0bfd-26c4-4905-9531-5bf90c65bf99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:42.201446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1226/2456] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:41 2022] DELETE /identity/v3/projects/db1396ee3254404486c248370f4b7861 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:42.209916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373a31f-ea3a-4bbf-9a48-ca723cc4cd6c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.210528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373a31f-ea3a-4bbf-9a48-ca723cc4cd6c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.210528 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373a31f-ea3a-4bbf-9a48-ca723cc4cd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.237829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0373a31f-ea3a-4bbf-9a48-ca723cc4cd6c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:42.239902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0373a31f-ea3a-4bbf-9a48-ca723cc4cd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:42.276403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:42.314951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1231/2457] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:42.322436 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504af2-3987-421f-b8b2-19e1709e98c2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.322883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504af2-3987-421f-b8b2-19e1709e98c2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.332039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31504af2-3987-421f-b8b2-19e1709e98c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.348921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-31504af2-3987-421f-b8b2-19e1709e98c2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:42.348921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-31504af2-3987-421f-b8b2-19e1709e98c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:42.363264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1227/2458] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:42.368418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373a31f-ea3a-4bbf-9a48-ca723cc4cd6c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:42.386599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373a31f-ea3a-4bbf-9a48-ca723cc4cd6c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:42.395296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:42.396611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.397130 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.397566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.398748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:30:42.399239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:42.402262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:42.425643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1232/2459] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:30:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:30:42.430416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504af2-3987-421f-b8b2-19e1709e98c2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:42.443752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31504af2-3987-421f-b8b2-19e1709e98c2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:42.448746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:42.449466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.449750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.450028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.450736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:42.452839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:42.552428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1228/2460] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:42 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:42.557822 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:42.575487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d9916-826f-467a-aaff-93ac1f2aa774 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:42.665798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:42.666514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.666798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.667077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.667777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:42.670134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:42.791536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1233/2461] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:42 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:42.799995 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:42.815793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781540d-6cb5-4cef-88a6-1e9e7d15ef7b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:42.822940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:42.823850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.823850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.824240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.824947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:42.826626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:42.841956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1229/2462] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:42.853118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:42.873420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77d702-36cc-4df7-b172-c20dbc25a8be admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:42.879508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f469a68-55a6-4615-8cdf-6b968b2d8632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:42.880295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469a68-55a6-4615-8cdf-6b968b2d8632 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.880584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469a68-55a6-4615-8cdf-6b968b2d8632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.880861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f469a68-55a6-4615-8cdf-6b968b2d8632 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.881853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469a68-55a6-4615-8cdf-6b968b2d8632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:42.883489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f469a68-55a6-4615-8cdf-6b968b2d8632 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:42.896249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1234/2463] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:42.902644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:42.916857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b98ad-75fc-4404-b00e-f61a5fb26f4c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:42.922712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:42.923741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:42.924025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:42.924428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] PATH_INFO: `/v3/projects/a75d612e6eed44d4b8d44b94318a3e91/users/fe8df5ec710a453f81a0e4974da78907/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:42.942790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a75d612e6eed44d4b8d44b94318a3e91, user_id=fe8df5ec710a453f81a0e4974da78907, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:42.945505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:42.949018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:43.084001 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1230/2464] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:42 2022] PUT /identity/v3/projects/a75d612e6eed44d4b8d44b94318a3e91/users/fe8df5ec710a453f81a0e4974da78907/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:43.095988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895569-65d9-4efa-9d97-68ab34f1f135 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:43.096517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895569-65d9-4efa-9d97-68ab34f1f135 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:43.097174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895569-65d9-4efa-9d97-68ab34f1f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:43.131611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6b895569-65d9-4efa-9d97-68ab34f1f135 None None] MFA Rules not processed for user `fe8df5ec710a453f81a0e4974da78907`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:43.132846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6b895569-65d9-4efa-9d97-68ab34f1f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:43.219579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1235/2465] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:43.225826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:43.308696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a793ad-0e55-4c83-8cf3-ca9b10700733 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:43.314024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:43.314692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:43.314981 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:43.315263 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:43.315979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:43.317968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:43.443851 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1231/2466] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:43 2022] POST /identity/v3/projects => generated 383 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:43.448738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895569-65d9-4efa-9d97-68ab34f1f135 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:43.461123 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895569-65d9-4efa-9d97-68ab34f1f135 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:43.494923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:43.530563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:43.532407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:43.532803 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:43.533225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:43.534049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:43.536004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:43.653082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1236/2467] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:43 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:43.657810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:43.676783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe014098-5190-49b3-b5e8-7e9f4041d552 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:43.681875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:43.683746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:43.684036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:43.684316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:43.685145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:43.687927 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:43.700053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1232/2468] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:43.705737 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:43.719340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0837364-b28c-451c-a696-c060002d58a2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:43.724327 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13a236-dfa0-492a-9086-1d28cca466a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:43.725059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13a236-dfa0-492a-9086-1d28cca466a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:43.725343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13a236-dfa0-492a-9086-1d28cca466a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:43.725617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13a236-dfa0-492a-9086-1d28cca466a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:43.726354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13a236-dfa0-492a-9086-1d28cca466a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:43.728001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13a236-dfa0-492a-9086-1d28cca466a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:43.740548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1237/2469] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:43.757843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:43.757843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a588527-bda3-49f2-a83c-68543f1a78e7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:43.761326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:43.762232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:43.762514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:43.762793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] PATH_INFO: `/v3/projects/546931c0675d4fe2af6d4a7ce2c7914f/users/4384d176c7164dc288f09c5030b8f6c6/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:43.782033 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=546931c0675d4fe2af6d4a7ce2c7914f, user_id=4384d176c7164dc288f09c5030b8f6c6, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:43.784798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:43.877729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1233/2470] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:43 2022] PUT /identity/v3/projects/546931c0675d4fe2af6d4a7ce2c7914f/users/4384d176c7164dc288f09c5030b8f6c6/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:43.890258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb89fb-b10a-4da2-92a9-187058d0ea45 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:43.891425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb89fb-b10a-4da2-92a9-187058d0ea45 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:43.891829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb89fb-b10a-4da2-92a9-187058d0ea45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:43.929447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-b1fb89fb-b10a-4da2-92a9-187058d0ea45 None None] MFA Rules not processed for user `4384d176c7164dc288f09c5030b8f6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:43.931783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-b1fb89fb-b10a-4da2-92a9-187058d0ea45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:44.021263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1238/2471] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:44.025972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:44.103996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de061b-29f3-4cca-a2f7-fa8cef574388 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:44.110209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:44.110905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:44.111191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:44.111474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:44.112193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:44.114335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:44.260760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1234/2472] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:44 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:44.266545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb89fb-b10a-4da2-92a9-187058d0ea45 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:44.278475 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb89fb-b10a-4da2-92a9-187058d0ea45 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:44.344605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:44.345393 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:44.345673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:44.345949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:44.346646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:44.348632 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:44.478004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1239/2473] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:44 2022] POST /identity/v3/users => generated 300 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:44.482671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:44.495482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29493536-a356-4b90-a094-6e44e646835f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:44.504138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:44.505061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:44.505424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:44.505721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:44.508191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:44.510197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:44.524776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1235/2474] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:44.529387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:44.541591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50163b44-3977-49b6-b649-1372bb013cf9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:44.547176 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:44.548103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:44.548387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:44.548830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] PATH_INFO: `/v3/projects/7ce8713d51a34e7283683ead575d0969/users/b99ddc3a1d1942a59d93b0fff65462ae/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:44.566945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce8713d51a34e7283683ead575d0969, user_id=b99ddc3a1d1942a59d93b0fff65462ae, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:44.569680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:44.683702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1240/2475] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:44 2022] PUT /identity/v3/projects/7ce8713d51a34e7283683ead575d0969/users/b99ddc3a1d1942a59d93b0fff65462ae/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:44.688373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:44.707757 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c85eb6-64b9-49ed-a780-72d84202f414 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:44.734112 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:44.791421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398618c-b0a2-4fdd-a19e-826d224971ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:44.792349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398618c-b0a2-4fdd-a19e-826d224971ac admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:44.792813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398618c-b0a2-4fdd-a19e-826d224971ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:44.793260 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398618c-b0a2-4fdd-a19e-826d224971ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:44.794477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398618c-b0a2-4fdd-a19e-826d224971ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:44.798025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398618c-b0a2-4fdd-a19e-826d224971ac admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:44.814455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1236/2476] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:44.819012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:44.824744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:44.832344 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5077acc-9f62-4365-962c-a9c52f0c2bdd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:44.837629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:44.838540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:44.838820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:44.839092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] PATH_INFO: `/v3/projects/7ce8713d51a34e7283683ead575d0969/users/b99ddc3a1d1942a59d93b0fff65462ae/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:44.842294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce8713d51a34e7283683ead575d0969, user_id=b99ddc3a1d1942a59d93b0fff65462ae, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:44.847462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:44.860767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1241/2477] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:44 2022] PUT /identity/v3/projects/7ce8713d51a34e7283683ead575d0969/users/b99ddc3a1d1942a59d93b0fff65462ae/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:44.871601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:44.871896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:44.872176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:44.904308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] MFA Rules not processed for user `b99ddc3a1d1942a59d93b0fff65462ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:44.906324 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:44.982083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1237/2478] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:44 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:44.993991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:44.995918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:45.070162 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8e7e-7874-4347-8b46-77f76ad40fdf admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:45.073781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591c8ef-97e6-419e-8c08-0bf3d1b505d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:45.074462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c8ef-97e6-419e-8c08-0bf3d1b505d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:45.074758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c8ef-97e6-419e-8c08-0bf3d1b505d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:45.075043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591c8ef-97e6-419e-8c08-0bf3d1b505d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:45.086395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c8ef-97e6-419e-8c08-0bf3d1b505d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:45.087866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591c8ef-97e6-419e-8c08-0bf3d1b505d1 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:45.101027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1242/2479] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:45.177047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:45.179061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:45.269928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805718f2-a360-4ea6-ab51-45ae40bc0eb8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:45.275786 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:45.276720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:45.277032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:45.277329 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] PATH_INFO: `/v3/users/5f0a4a5f21f44887ac2f77693a764552` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:45.278678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0a4a5f21f44887ac2f77693a764552)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:45.281869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:45.506929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:45.510773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0a4a5f21f44887ac2f77693a764552'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:45.602996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0a4a5f21f44887ac2f77693a764552'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:45.604525 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0a4a5f21f44887ac2f77693a764552'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:45.620717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0a4a5f21f44887ac2f77693a764552'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:45.621509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0a4a5f21f44887ac2f77693a764552'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:45.647186 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1238/2480] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:45 2022] DELETE /identity/v3/users/5f0a4a5f21f44887ac2f77693a764552 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:45.652160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:45.653308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:45.653763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:45.677365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:45.678699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:45.751657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1243/2481] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:45.761727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:45.763445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:45.834030 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa1499-fd52-42ff-b2c9-f46697234816 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:45.837941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:45.838601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:45.838884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:45.839159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:45.850243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:45.851769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:45.863320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1239/2482] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:46.417313 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:46.418972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:46.450297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:46.452844 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:46.469524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ce4b7-88a4-4258-bd31-9a63edf82b3d service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:46.476429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:46.477560 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:46.487692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:46.487692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] PATH_INFO: `/v3/projects/19eaa57d89354a2bab08c507f49656ae` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:46.487692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19eaa57d89354a2bab08c507f49656ae)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:46.487692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:46.501793 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319d5fd-f050-43bd-9d95-e2b0ae1bcc15 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:46.506285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccd797-1ffc-438c-a0bf-d8b1581834cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:46.507641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccd797-1ffc-438c-a0bf-d8b1581834cf service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:46.508001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccd797-1ffc-438c-a0bf-d8b1581834cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:46.508488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccd797-1ffc-438c-a0bf-d8b1581834cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:46.510791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-47ccd797-1ffc-438c-a0bf-d8b1581834cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:46.574553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:46.593477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccd797-1ffc-438c-a0bf-d8b1581834cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:46.595069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccd797-1ffc-438c-a0bf-d8b1581834cf service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:46.607323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1244/2483] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:46.654665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19eaa57d89354a2bab08c507f49656ae', 'request_id': 'req-271c8eab-c862-438f-9eeb-586d87d4f279'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:46.662944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19eaa57d89354a2bab08c507f49656ae', 'request_id': 'req-271c8eab-c862-438f-9eeb-586d87d4f279'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:46.767729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19eaa57d89354a2bab08c507f49656ae', 'request_id': 'req-271c8eab-c862-438f-9eeb-586d87d4f279'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:46.787527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] The token cache is being invalidate because project 19eaa57d89354a2bab08c507f49656ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:46.787948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:46.788756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-271c8eab-c862-438f-9eeb-586d87d4f279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:46.790907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1240/2484] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:46 2022] DELETE /identity/v3/projects/19eaa57d89354a2bab08c507f49656ae => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:46.796284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a264b-4d1c-4265-b72d-328bb0216b4b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:46.797036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a264b-4d1c-4265-b72d-328bb0216b4b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:46.797036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a264b-4d1c-4265-b72d-328bb0216b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:46.818975 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-0b2a264b-4d1c-4265-b72d-328bb0216b4b None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:46.820211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0b2a264b-4d1c-4265-b72d-328bb0216b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:46.917709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1245/2485] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:46.929228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1f262-85cd-4125-82e6-439d2c0c2352 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:46.929781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1f262-85cd-4125-82e6-439d2c0c2352 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:46.930296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a1f262-85cd-4125-82e6-439d2c0c2352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:46.957061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-51a1f262-85cd-4125-82e6-439d2c0c2352 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:46.958282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-51a1f262-85cd-4125-82e6-439d2c0c2352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:46.977595 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1241/2486] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:46.981868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a264b-4d1c-4265-b72d-328bb0216b4b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:46.997848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a264b-4d1c-4265-b72d-328bb0216b4b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:47.004049 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:47.005036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.005291 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.005637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.006491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:30:47.006798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:47.008483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:47.022538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1246/2487] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:30:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:30:47.028892 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1f262-85cd-4125-82e6-439d2c0c2352 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:47.040313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a1f262-85cd-4125-82e6-439d2c0c2352 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:47.045940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:47.046905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.047281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.047674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.048279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:47.050660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:47.159116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1242/2488] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:47 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:47.163930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:47.187965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a985846d-229d-401b-9488-bc45d132dada admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:47.293267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:47.294646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.295159 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.296868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.298681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:47.303620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:47.444227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1247/2489] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:47 2022] POST /identity/v3/users => generated 297 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:47.449094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:47.462899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5189a-45d6-45f4-b489-71a25858a422 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:47.468785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:47.469498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.469785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.470067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.470831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:47.472540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:47.487642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1243/2490] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:47.493397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:47.509077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6499bf-def8-45f3-825a-32e792c91e1a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:47.511874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d3b88-9b37-4daa-9d44-120e50e04b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:47.512573 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3b88-9b37-4daa-9d44-120e50e04b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.512856 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3b88-9b37-4daa-9d44-120e50e04b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.513200 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d3b88-9b37-4daa-9d44-120e50e04b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.514009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d3b88-9b37-4daa-9d44-120e50e04b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:47.516701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d3b88-9b37-4daa-9d44-120e50e04b95 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:47.531716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1248/2491] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:47.538248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:47.555138 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f123f7f-4669-446f-878f-cadfdc04d523 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:47.563956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:47.565664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.566182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.566827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] PATH_INFO: `/v3/projects/6cfa3b9d0efe48659d96ee4cb3cc5191/users/7acbc41358f0440d97bfa0eae8f4eaac/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.571385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:47.595861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cfa3b9d0efe48659d96ee4cb3cc5191, user_id=7acbc41358f0440d97bfa0eae8f4eaac, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:47.598890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:47.715164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1244/2492] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:47 2022] PUT /identity/v3/projects/6cfa3b9d0efe48659d96ee4cb3cc5191/users/7acbc41358f0440d97bfa0eae8f4eaac/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:47.727596 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bb51-5d8d-41a3-9836-454167b238d7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.727902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bb51-5d8d-41a3-9836-454167b238d7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.728191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75bb51-5d8d-41a3-9836-454167b238d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.761574 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6f75bb51-5d8d-41a3-9836-454167b238d7 None None] MFA Rules not processed for user `7acbc41358f0440d97bfa0eae8f4eaac`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:47.762991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6f75bb51-5d8d-41a3-9836-454167b238d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:47.830916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:47.873061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1249/2493] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:30:47.884055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:47.972700 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a621d9b1-468f-4afd-8f6b-9fd1b5df5b39 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:47.978072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:47.978914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:47.979123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:47.979406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:47.980171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:47.982467 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:48.090819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1245/2494] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:47 2022] POST /identity/v3/projects => generated 393 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:48.096640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75bb51-5d8d-41a3-9836-454167b238d7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:48.109642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75bb51-5d8d-41a3-9836-454167b238d7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:48.174579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:48.175255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.175536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.175810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:48.176499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:48.178542 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:48.289374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1250/2495] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:48 2022] POST /identity/v3/users => generated 303 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:48.294283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:48.307552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f4482-7a18-4a25-845c-e59e2cdf7153 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:48.313243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:48.314143 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.314429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.314708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:48.315449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:48.317095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:48.330223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1246/2496] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:48.334603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:48.352325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39deaec3-15b0-4260-94e7-3fe16799399a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:48.358754 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:48.359801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.360091 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.360394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] PATH_INFO: `/v3/projects/fe11cca6883141d9a7e3ea87f45a3bfc/users/3269fec9ae124fa6ab741bdb67f36df2/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:48.377871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe11cca6883141d9a7e3ea87f45a3bfc, user_id=3269fec9ae124fa6ab741bdb67f36df2, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:48.380560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:48.466914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1251/2497] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:48 2022] PUT /identity/v3/projects/fe11cca6883141d9a7e3ea87f45a3bfc/users/3269fec9ae124fa6ab741bdb67f36df2/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:48.477232 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:48.490278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133048-847f-4802-87da-ed66680b7d69 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:48.564731 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a34793c-d85f-4f91-bf24-d4fe035955d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:48.565466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34793c-d85f-4f91-bf24-d4fe035955d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.565752 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34793c-d85f-4f91-bf24-d4fe035955d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.566031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a34793c-d85f-4f91-bf24-d4fe035955d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:48.566772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34793c-d85f-4f91-bf24-d4fe035955d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:48.568363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a34793c-d85f-4f91-bf24-d4fe035955d2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:48.580009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1247/2498] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:48.586417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:48.598000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89394a30-be34-482c-8982-d133b4edaff5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:48.602960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:48.603815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.604097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.604405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] PATH_INFO: `/v3/projects/fe11cca6883141d9a7e3ea87f45a3bfc/users/3269fec9ae124fa6ab741bdb67f36df2/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:48.606481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe11cca6883141d9a7e3ea87f45a3bfc, user_id=3269fec9ae124fa6ab741bdb67f36df2, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:48.609382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:48.620379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1252/2499] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:48 2022] PUT /identity/v3/projects/fe11cca6883141d9a7e3ea87f45a3bfc/users/3269fec9ae124fa6ab741bdb67f36df2/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:48.631088 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.631385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.631664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:48.660916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] MFA Rules not processed for user `3269fec9ae124fa6ab741bdb67f36df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:48.662211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:48.711539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:48.747219 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1248/2500] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:48.761679 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:48.767765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:48.841892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec443c-fe28-403f-854b-d17eea8877bb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:48.845405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:48.846146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.846529 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.847673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:48.861126 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:48.863765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:48.881213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1253/2501] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:48.943887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:48.946519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:48.960119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1938f10-8031-40d6-ad1b-9e5a459285d5 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:48.964135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:48.964791 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:48.965132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:48.965412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:49.027296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:49.028514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:49.038161 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1249/2502] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:52.038249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:52.052357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d403b4b1-c4c7-4001-b1e1-2d6bae88504a service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:52.056014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84fa9e-e072-46c6-b59f-bc239b6cd3d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:52.056655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84fa9e-e072-46c6-b59f-bc239b6cd3d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:52.056936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84fa9e-e072-46c6-b59f-bc239b6cd3d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:52.057302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84fa9e-e072-46c6-b59f-bc239b6cd3d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:52.059097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9b84fa9e-e072-46c6-b59f-bc239b6cd3d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:52.091643 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:52.145910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84fa9e-e072-46c6-b59f-bc239b6cd3d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:52.147343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84fa9e-e072-46c6-b59f-bc239b6cd3d4 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:52.161136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1254/2503] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:54.244000 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:54.450567 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f8cc-b2bc-4c37-bfe7-4f7297483585 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:54.456108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:54.457024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:54.462012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:54.462012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] PATH_INFO: `/v3/users/7acbc41358f0440d97bfa0eae8f4eaac` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:54.462012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acbc41358f0440d97bfa0eae8f4eaac)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:54.462012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:54.629403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:54.641487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acbc41358f0440d97bfa0eae8f4eaac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:54.717880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acbc41358f0440d97bfa0eae8f4eaac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:54.719679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acbc41358f0440d97bfa0eae8f4eaac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:54.742403 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acbc41358f0440d97bfa0eae8f4eaac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:54.743546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acbc41358f0440d97bfa0eae8f4eaac'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:54.766725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1250/2504] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:54 2022] DELETE /identity/v3/users/7acbc41358f0440d97bfa0eae8f4eaac => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:54.774229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:54.774837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:54.775217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:54.830806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:54.832111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:54.905361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1255/2505] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:54.916950 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:54.918661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:55.063124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a41d500-aa76-4832-a6f5-521ac599171b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:55.069830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:55.072330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:55.072330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:55.072330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:55.090520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:55.091265 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:55.108701 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1251/2506] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:30:55.643245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:55.648062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:55.667629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130118f9-2271-44b1-bd40-99d4a5f663b7 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:55.674489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:55.675387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:55.675688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:55.675960 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] PATH_INFO: `/v3/projects/6cfa3b9d0efe48659d96ee4cb3cc5191` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:55.738646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cfa3b9d0efe48659d96ee4cb3cc5191)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:55.738646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:55.863768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cfa3b9d0efe48659d96ee4cb3cc5191', 'request_id': 'req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:55.871121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cfa3b9d0efe48659d96ee4cb3cc5191', 'request_id': 'req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:55.951109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cfa3b9d0efe48659d96ee4cb3cc5191', 'request_id': 'req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:55.967916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] The token cache is being invalidate because project 6cfa3b9d0efe48659d96ee4cb3cc5191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:55.968275 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:55.969013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:55.970757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1256/2507] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:55 2022] DELETE /identity/v3/projects/6cfa3b9d0efe48659d96ee4cb3cc5191 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:55.975095 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:55.987142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faca812-2a38-4565-82f3-ecf426508e70 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:56.072735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:56.073971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:56.074311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:56.074813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] PATH_INFO: `/v3/users/3269fec9ae124fa6ab741bdb67f36df2` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:56.076954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3269fec9ae124fa6ab741bdb67f36df2)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:56.082706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:56.115914 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:56.345215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3269fec9ae124fa6ab741bdb67f36df2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:56.419997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3269fec9ae124fa6ab741bdb67f36df2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:56.420772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3269fec9ae124fa6ab741bdb67f36df2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:56.435938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3269fec9ae124fa6ab741bdb67f36df2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:56.436708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3269fec9ae124fa6ab741bdb67f36df2'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:56.451411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1252/2508] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:55 2022] DELETE /identity/v3/users/3269fec9ae124fa6ab741bdb67f36df2 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:56.982460 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:56.985951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:57.007361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80ff49-806f-4bcc-b550-5b6bc2836eb3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:57.035221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:57.098259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:57.099234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.099588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.099874 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] PATH_INFO: `/v3/projects/fe11cca6883141d9a7e3ea87f45a3bfc` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.101268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe11cca6883141d9a7e3ea87f45a3bfc)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:57.103244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:57.307885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe11cca6883141d9a7e3ea87f45a3bfc', 'request_id': 'req-e28ee531-2848-4c54-92b2-77207fb37233'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.315481 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe11cca6883141d9a7e3ea87f45a3bfc', 'request_id': 'req-e28ee531-2848-4c54-92b2-77207fb37233'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.318948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:57.320472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:57.334953 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2381ba48-52d0-407f-816d-c66a3ae983be admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:57.400229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:57.401251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.401527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.401810 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] PATH_INFO: `/v3/users/fe8df5ec710a453f81a0e4974da78907` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.403058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8df5ec710a453f81a0e4974da78907)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:57.405256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:57.409403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe11cca6883141d9a7e3ea87f45a3bfc', 'request_id': 'req-e28ee531-2848-4c54-92b2-77207fb37233'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.445677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] The token cache is being invalidate because project fe11cca6883141d9a7e3ea87f45a3bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:57.446167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.447007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e28ee531-2848-4c54-92b2-77207fb37233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.448727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1257/2509] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:56 2022] DELETE /identity/v3/projects/fe11cca6883141d9a7e3ea87f45a3bfc => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:57.454396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4e6d-a4bc-4f95-9396-6d6bb5519ab6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.454686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4e6d-a4bc-4f95-9396-6d6bb5519ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.454976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78c4e6d-a4bc-4f95-9396-6d6bb5519ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.512359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f78c4e6d-a4bc-4f95-9396-6d6bb5519ab6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:57.513545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f78c4e6d-a4bc-4f95-9396-6d6bb5519ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:57.523143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1258/2510] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:57.533941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0c33-e47d-4c0d-adec-0305042f4f8e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.534490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0c33-e47d-4c0d-adec-0305042f4f8e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.534998 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b0c33-e47d-4c0d-adec-0305042f4f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.560942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-951b0c33-e47d-4c0d-adec-0305042f4f8e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:57.562286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-951b0c33-e47d-4c0d-adec-0305042f4f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:57.570777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1259/2511] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:57.575233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b0c33-e47d-4c0d-adec-0305042f4f8e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:57.585569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b0c33-e47d-4c0d-adec-0305042f4f8e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:57.591076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:57.592288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.592771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.593386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.595369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:30:57.595906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:57.598980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:57.620255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1260/2512] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:30:57.625457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:57.645225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c139e9-bb74-474e-9874-7c084ee0739d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:57.655209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:57.657802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.657802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.658352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.659107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:57.661341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:57.669754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8df5ec710a453f81a0e4974da78907'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.762129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8df5ec710a453f81a0e4974da78907'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.762800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8df5ec710a453f81a0e4974da78907'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.777809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8df5ec710a453f81a0e4974da78907'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.778511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-70f2e2be-14b2-499f-b6e2-7f60dc967c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8df5ec710a453f81a0e4974da78907'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:57.781171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1261/2513] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:57 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:57.785927 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:57.787705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:57.796355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1253/2514] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:57 2022] DELETE /identity/v3/users/fe8df5ec710a453f81a0e4974da78907 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:57.799021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.799021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.799465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.821170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:57.822604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:57.825081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:57.841411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:57.869004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3320a8cc-630a-4c8a-947e-d44fced4b331 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:57.914659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1254/2515] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:57.930528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:57.932690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:57.947059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:57.948728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:57.948728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:57.948728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:57.949269 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:57.951292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.012114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613333f7-103f-47b0-9d64-1b20e6cd89f8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.016570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.017211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.017503 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.017783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.028589 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.030118 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.033220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1262/2516] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:57 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:58.037513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.044395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1255/2517] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:30:58.052002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e375b2c-9e44-4649-906b-f0cb22621112 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.057006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.057701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.058006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.058386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.059180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.063004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.075082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1263/2518] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:58.080142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.091323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cfff2-f312-4678-ac20-4dadb9c3e76e service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.096875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863674f-7012-4cfb-a0c7-bdf076b1ce6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.097794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863674f-7012-4cfb-a0c7-bdf076b1ce6f admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.097964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863674f-7012-4cfb-a0c7-bdf076b1ce6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.098178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863674f-7012-4cfb-a0c7-bdf076b1ce6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.098865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863674f-7012-4cfb-a0c7-bdf076b1ce6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.100505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863674f-7012-4cfb-a0c7-bdf076b1ce6f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.112783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1256/2519] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:58.117850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.137133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dec97-8352-470c-96a7-389bc06acfec admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.146485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.147987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.148289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.148578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] PATH_INFO: `/v3/projects/3bdeca1b6442487d9988300237ab9dde/users/1f8f8fd996ab4515a3df0b726e192c6e/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.166545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bdeca1b6442487d9988300237ab9dde, user_id=1f8f8fd996ab4515a3df0b726e192c6e, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.169300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.249788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1264/2520] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:58 2022] PUT /identity/v3/projects/3bdeca1b6442487d9988300237ab9dde/users/1f8f8fd996ab4515a3df0b726e192c6e/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:58.261972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.262532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.262896 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.305282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] MFA Rules not processed for user `1f8f8fd996ab4515a3df0b726e192c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:58.306737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:58.403733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1257/2521] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:58.409597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.491024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f3461e-b629-46f0-a7af-1017e3a2e6d0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.496125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.496805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.497124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.497535 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.498257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.500805 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.587318 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.588785 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:58.604240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8017f-d84f-46a9-85c3-994a887aacbe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.615164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.616958 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.617484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.618184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] PATH_INFO: `/v3/projects/a75d612e6eed44d4b8d44b94318a3e91` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.619516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a75d612e6eed44d4b8d44b94318a3e91)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.622091 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.628640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1265/2522] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:30:58 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:30:58.633530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.654757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:58.712458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50f724-412b-4e60-a033-843543347ee6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.720662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:58.729873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a75d612e6eed44d4b8d44b94318a3e91', 'request_id': 'req-7c040759-0ab1-4ee2-a963-4364e186528b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:58.737238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a75d612e6eed44d4b8d44b94318a3e91', 'request_id': 'req-7c040759-0ab1-4ee2-a963-4364e186528b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:58.779492 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a75d612e6eed44d4b8d44b94318a3e91', 'request_id': 'req-7c040759-0ab1-4ee2-a963-4364e186528b'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:58.793930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] The token cache is being invalidate because project a75d612e6eed44d4b8d44b94318a3e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:30:58.794732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:58.795128 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:58.797690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1258/2523] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:58 2022] DELETE /identity/v3/projects/a75d612e6eed44d4b8d44b94318a3e91 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:58.801769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.801973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.803456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:58.803841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.804239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.804683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.805684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.808553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.818872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c040759-0ab1-4ee2-a963-4364e186528b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.827790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.829127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.832297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.832297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] PATH_INFO: `/v3/users/4384d176c7164dc288f09c5030b8f6c6` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.832297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4384d176c7164dc288f09c5030b8f6c6)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.832943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.901587 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1266/2524] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:30:58 2022] POST /identity/v3/users => generated 298 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:30:58.905631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.908279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:58.920835 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488609d7-9f79-4125-949b-88804f5009c0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.928692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.928692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.929165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.929297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.930011 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.931692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.947636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1267/2525] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:30:58.952139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:58.964470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f7e7a-bc31-4544-a8d3-eea9f7e80009 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:58.969659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:58.970563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:58.970853 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:58.971134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] PATH_INFO: `/v3/projects/5d0ed82b60f84c7485586e49e319568e/users/35985400fbce483d9fc3da110e99f2ee/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:58.990196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0ed82b60f84c7485586e49e319568e, user_id=35985400fbce483d9fc3da110e99f2ee, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:58.993160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:58.998409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4384d176c7164dc288f09c5030b8f6c6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:59.070466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4384d176c7164dc288f09c5030b8f6c6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:59.074422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1268/2526] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:58 2022] PUT /identity/v3/projects/5d0ed82b60f84c7485586e49e319568e/users/35985400fbce483d9fc3da110e99f2ee/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:30:59.075320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4384d176c7164dc288f09c5030b8f6c6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:59.078907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:59.081213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:59.101108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4384d176c7164dc288f09c5030b8f6c6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:59.101945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4384d176c7164dc288f09c5030b8f6c6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:30:59.121129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1259/2527] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:30:58 2022] DELETE /identity/v3/users/4384d176c7164dc288f09c5030b8f6c6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:59.193801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c289a1-e868-4090-9b23-1e58584e8b52 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:59.222341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:59.279825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232964-f00c-4f1b-b07b-046578f8e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:59.280526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232964-f00c-4f1b-b07b-046578f8e14e admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:59.280831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232964-f00c-4f1b-b07b-046578f8e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:59.281606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232964-f00c-4f1b-b07b-046578f8e14e admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:59.282388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232964-f00c-4f1b-b07b-046578f8e14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:59.284081 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232964-f00c-4f1b-b07b-046578f8e14e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:59.302598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1269/2528] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:30:59.308380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:59.324733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2dde4f-c1a1-4422-a08f-637cce4766a2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:59.330553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:59.335648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:59.335648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:59.335648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] PATH_INFO: `/v3/projects/5d0ed82b60f84c7485586e49e319568e/users/35985400fbce483d9fc3da110e99f2ee/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:59.335648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d0ed82b60f84c7485586e49e319568e, user_id=35985400fbce483d9fc3da110e99f2ee, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:59.336805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:59.350233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1260/2529] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:30:59 2022] PUT /identity/v3/projects/5d0ed82b60f84c7485586e49e319568e/users/35985400fbce483d9fc3da110e99f2ee/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:30:59.361684 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:59.361991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:59.362264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:59.399188 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] MFA Rules not processed for user `35985400fbce483d9fc3da110e99f2ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:30:59.401346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:59.496016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1270/2530] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:30:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:30:59.508141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:59.510777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:59.631246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39093c-a5f8-4b55-ba43-a0a578702282 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:59.636096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:59.636915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:59.637152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:59.637432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:59.639447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:59.668183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:30:59.747855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:59.749725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:30:59.764386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1261/2531] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:30:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:30:59.830075 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:30:59.836731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:30:59.936439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf8344-8f3c-445a-9783-82ed88719b1f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:30:59.944171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:30:59.945119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:30:59.948079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:30:59.948079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] PATH_INFO: `/v3/projects/546931c0675d4fe2af6d4a7ce2c7914f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:30:59.948079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546931c0675d4fe2af6d4a7ce2c7914f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:30:59.949414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:00.139689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:00.145113 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546931c0675d4fe2af6d4a7ce2c7914f', 'request_id': 'req-916a3ddf-247a-41ac-b628-027421e40db1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.154503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546931c0675d4fe2af6d4a7ce2c7914f', 'request_id': 'req-916a3ddf-247a-41ac-b628-027421e40db1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.259296 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546931c0675d4fe2af6d4a7ce2c7914f', 'request_id': 'req-916a3ddf-247a-41ac-b628-027421e40db1'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.274672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] The token cache is being invalidate because project 546931c0675d4fe2af6d4a7ce2c7914f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:00.285120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.285120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.287582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1271/2532] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:30:59 2022] DELETE /identity/v3/projects/546931c0675d4fe2af6d4a7ce2c7914f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:00.291410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:00.304555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9bcf7-07ed-44c0-a1c1-0dcf16bae2c4 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:00.428214 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:00.428652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:00.429330 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:00.430105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] PATH_INFO: `/v3/users/b99ddc3a1d1942a59d93b0fff65462ae` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:00.432610 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99ddc3a1d1942a59d93b0fff65462ae)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:00.436828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:00.674297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99ddc3a1d1942a59d93b0fff65462ae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.785363 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99ddc3a1d1942a59d93b0fff65462ae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.787312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99ddc3a1d1942a59d93b0fff65462ae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.803482 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99ddc3a1d1942a59d93b0fff65462ae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.804588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-66ae2c9f-3020-475f-b1f4-3e32acb018d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99ddc3a1d1942a59d93b0fff65462ae'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:00.821929 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1262/2533] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:00 2022] DELETE /identity/v3/users/b99ddc3a1d1942a59d93b0fff65462ae => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:01.318445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:01.321654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:01.354111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a3ddf-247a-41ac-b628-027421e40db1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:01.473259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:01.474601 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:01.474845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:01.475027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] PATH_INFO: `/v3/projects/7ce8713d51a34e7283683ead575d0969` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:01.477273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce8713d51a34e7283683ead575d0969)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:01.478347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:01.768238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce8713d51a34e7283683ead575d0969', 'request_id': 'req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:01.778919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce8713d51a34e7283683ead575d0969', 'request_id': 'req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:01.923398 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce8713d51a34e7283683ead575d0969', 'request_id': 'req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:01.942295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] The token cache is being invalidate because project 7ce8713d51a34e7283683ead575d0969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:01.943271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:01.948178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f335ef1-5847-4625-b10c-7f4fdb4a7db8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:01.953915 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1272/2534] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:01 2022] DELETE /identity/v3/projects/7ce8713d51a34e7283683ead575d0969 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:01.956559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef7e89-7e54-4cd6-b1c6-e2187b115eee None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:01.957495 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef7e89-7e54-4cd6-b1c6-e2187b115eee None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:01.957826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef7e89-7e54-4cd6-b1c6-e2187b115eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:01.977448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-24ef7e89-7e54-4cd6-b1c6-e2187b115eee None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:01.978715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-24ef7e89-7e54-4cd6-b1c6-e2187b115eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:02.029773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:02.067979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1263/2535] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:02.139547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86164535-f823-441d-ac11-3a5cc0c53e38 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.139840 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86164535-f823-441d-ac11-3a5cc0c53e38 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.140088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86164535-f823-441d-ac11-3a5cc0c53e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.162487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-86164535-f823-441d-ac11-3a5cc0c53e38 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:02.164503 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-86164535-f823-441d-ac11-3a5cc0c53e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:02.176004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1273/2536] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:02.183968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef7e89-7e54-4cd6-b1c6-e2187b115eee None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:02.195821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef7e89-7e54-4cd6-b1c6-e2187b115eee None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:02.201796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:02.203036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.203361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.203644 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.204432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:02.204745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:02.206504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:02.227024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1264/2537] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:31:02.228917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86164535-f823-441d-ac11-3a5cc0c53e38 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:02.253372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86164535-f823-441d-ac11-3a5cc0c53e38 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:02.262251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:02.263425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.264017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.264441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.266728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:02.269921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:02.385163 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1274/2538] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:02 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:02.390876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:02.402225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026cd1f-7ec5-4b07-97b4-02fb5a1ee4d1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:02.475241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:02.476122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.476244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.476511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.477247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:02.479471 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:02.576253 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1265/2539] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:02 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:02.579776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:02.606815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bac939-d5f5-4fa2-b463-5c0c2144e6e1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:02.613936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:02.614788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.615190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.615545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.616499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:02.618804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:02.632384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1275/2540] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:02.636366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:02.653821 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764b1f2-d900-41ca-840f-c40985380857 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:02.659256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c677791-d6bf-432a-b352-9fde374e8364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:02.660013 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677791-d6bf-432a-b352-9fde374e8364 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.660331 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677791-d6bf-432a-b352-9fde374e8364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.660613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c677791-d6bf-432a-b352-9fde374e8364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.661555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677791-d6bf-432a-b352-9fde374e8364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:02.663406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c677791-d6bf-432a-b352-9fde374e8364 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:02.675679 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1266/2541] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:02.680342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:02.692616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20804f44-f04e-4c83-8ec1-2d03fbd69c47 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:02.698246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:02.699158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.699502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.699876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] PATH_INFO: `/v3/projects/d20c00f5516f499a98d2dfb93aca606d/users/fafd313690244de9b2b534fee6b55146/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.722796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d20c00f5516f499a98d2dfb93aca606d, user_id=fafd313690244de9b2b534fee6b55146, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:02.725753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:02.792952 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:02.805469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1276/2542] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:02 2022] PUT /identity/v3/projects/d20c00f5516f499a98d2dfb93aca606d/users/fafd313690244de9b2b534fee6b55146/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:02.813932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2d320-37a2-4b12-95ae-8b80e3a645d8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:02.814280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2d320-37a2-4b12-95ae-8b80e3a645d8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:02.814554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2d320-37a2-4b12-95ae-8b80e3a645d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:02.841910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ccd2d320-37a2-4b12-95ae-8b80e3a645d8 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:02.843449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ccd2d320-37a2-4b12-95ae-8b80e3a645d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:02.938306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1267/2543] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:02.960608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:02.962494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:03.058999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf9d2b-a6ac-472c-9753-3dbbb6e148b3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:03.064316 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:03.065267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:03.065640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:03.065978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:03.077636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:03.080705 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:03.093309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1277/2544] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:04.809235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1e7f-3cd3-497e-8608-bda5834b1589 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:04.809963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1e7f-3cd3-497e-8608-bda5834b1589 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:04.809963 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea1e7f-3cd3-497e-8608-bda5834b1589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:04.844272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-73ea1e7f-3cd3-497e-8608-bda5834b1589 None None] MFA Rules not processed for user `fafd313690244de9b2b534fee6b55146`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:04.846328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-73ea1e7f-3cd3-497e-8608-bda5834b1589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:04.910747 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:04.970217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1268/2545] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:04.975297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:04.986373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cc1c2-2a33-4dfa-9ab4-b20ecbbe56e2 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:04.991230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:04.991893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:04.992244 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:04.992607 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:04.993341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:04.995342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:05.123903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1278/2546] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:04 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:31:05.131268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1e7f-3cd3-497e-8608-bda5834b1589 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:05.151288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea1e7f-3cd3-497e-8608-bda5834b1589 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:05.225216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:05.226295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:05.226828 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:05.227382 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:05.228706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:05.232146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:05.363017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1269/2547] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:05 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:05.369534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:05.389495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d3468-3a7a-48b0-8240-2061687094c4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:05.398027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:05.398820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:05.399208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:05.399578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:05.400410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:05.402329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:05.448534 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1279/2548] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:05.449782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:05.475169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee5a722-db7e-4210-868b-fd52d6af69ef admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:05.483737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:05.484942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:05.485472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:05.485847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] PATH_INFO: `/v3/projects/7aad3e895d894634b547e28e0c1f1a3f/users/d6da369cd9174a85b30cf561f5c53430/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:05.512555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aad3e895d894634b547e28e0c1f1a3f, user_id=d6da369cd9174a85b30cf561f5c53430, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:05.517727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:05.572483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:05.574322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:05.643914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ad2a7-cf04-4d78-bab2-285b80940cf6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:05.648206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:05.648911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:05.649233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:05.649517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:05.651890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:05.677942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1270/2549] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:05 2022] PUT /identity/v3/projects/7aad3e895d894634b547e28e0c1f1a3f/users/d6da369cd9174a85b30cf561f5c53430/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:05.684362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:05.759885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:05.761474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:05.773079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1280/2550] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:05.780859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d512-285f-46c2-8fd4-ca8b5c2a5050 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:05.790866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f819172-3982-44c7-8854-305737609dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:05.792040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f819172-3982-44c7-8854-305737609dda admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:05.792551 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f819172-3982-44c7-8854-305737609dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:05.793093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f819172-3982-44c7-8854-305737609dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:05.794523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f819172-3982-44c7-8854-305737609dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:05.799281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f819172-3982-44c7-8854-305737609dda admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:05.828480 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1271/2551] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:31:05.832098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:05.843954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354cf51-c144-4a91-b2b5-a44927714da1 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:05.849131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da50df-8949-4730-b564-896a2a6c01c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:05.850045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da50df-8949-4730-b564-896a2a6c01c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:05.850325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da50df-8949-4730-b564-896a2a6c01c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:05.850597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da50df-8949-4730-b564-896a2a6c01c2 admin admin] PATH_INFO: `/v3/projects/7aad3e895d894634b547e28e0c1f1a3f/users/d6da369cd9174a85b30cf561f5c53430/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:05.853092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da50df-8949-4730-b564-896a2a6c01c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aad3e895d894634b547e28e0c1f1a3f, user_id=d6da369cd9174a85b30cf561f5c53430, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:05.855905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da50df-8949-4730-b564-896a2a6c01c2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:05.869948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1281/2552] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:05 2022] PUT /identity/v3/projects/7aad3e895d894634b547e28e0c1f1a3f/users/d6da369cd9174a85b30cf561f5c53430/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:07.445947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:07.446543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:07.446543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:07.476379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] MFA Rules not processed for user `d6da369cd9174a85b30cf561f5c53430`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:07.478236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:07.507721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:07.573783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1272/2553] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:07 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:07.602610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:07.603302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:07.603302 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:07.612758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:07.626062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] MFA Rules not processed for user `fafd313690244de9b2b534fee6b55146`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:07.627299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:07.692609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1282/2554] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:07.708787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:07.710556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:07.798323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9915c3-f933-474f-a13f-c3d52a5894f8 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:07.804565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:07.805277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:07.805771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:07.806170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:07.816169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:07.817855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:07.829585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1273/2555] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:08.092236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:08.094758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:08.155290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:08.205336 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855bbf6-b04a-4147-a85a-22979d3680b3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:08.210064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:08.211050 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:08.211517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:08.211983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:08.214799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:08.233136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4f5b7-acc2-4bf8-a3d2-68a3db9b4abb service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:08.238598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:08.239460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:08.239908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:08.240323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:08.242565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:08.256316 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:08.258397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:08.269788 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1274/2556] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:08.330598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:08.332053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:08.347360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1283/2557] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:08.841086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:08.843304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:08.907478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:08.933369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398b26a-e77a-4544-802a-367c1e890855 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:08.940607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb90ba3-dcaa-4243-9830-01531136d168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:08.941421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb90ba3-dcaa-4243-9830-01531136d168 service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:08.941787 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb90ba3-dcaa-4243-9830-01531136d168 service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:08.942197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb90ba3-dcaa-4243-9830-01531136d168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:08.944729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bdb90ba3-dcaa-4243-9830-01531136d168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:08.962559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb90ba3-dcaa-4243-9830-01531136d168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:08.965456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb90ba3-dcaa-4243-9830-01531136d168 service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:08.978939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1275/2558] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:11.202359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:11.218017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca839ce6-c728-42c5-a03c-abf882f7db4d service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:11.242653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:11.247530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:11.247530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:11.247530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:11.247530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:11.268391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:11.271717 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:11.286647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1284/2559] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:11.451328 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:11.452970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:11.452970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:11.492884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:11.494159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:11.624310 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1276/2560] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:31:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:11.809742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:11.811353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:11.883541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:11.906071 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098eb9ae-2262-4046-9a8a-4ef6c099e744 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:11.911476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24141f1a-280f-4962-a284-4931a574545b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:11.912134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24141f1a-280f-4962-a284-4931a574545b service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:11.912426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24141f1a-280f-4962-a284-4931a574545b service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:11.912701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24141f1a-280f-4962-a284-4931a574545b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:11.922138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24141f1a-280f-4962-a284-4931a574545b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:11.923777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24141f1a-280f-4962-a284-4931a574545b service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:11.932865 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1285/2561] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:31:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:31:12.102162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:12.106387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:12.144181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2999a06-3a29-4fbe-987d-936092aae121 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:12.163725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:12.164636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:12.164919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:12.165223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] PATH_INFO: `/v3/users/1f8f8fd996ab4515a3df0b726e192c6e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:12.172952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8f8fd996ab4515a3df0b726e192c6e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:12.176720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:12.495106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8f8fd996ab4515a3df0b726e192c6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:12.614290 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8f8fd996ab4515a3df0b726e192c6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:12.615315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8f8fd996ab4515a3df0b726e192c6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:12.663434 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8f8fd996ab4515a3df0b726e192c6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:12.666074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8f8fd996ab4515a3df0b726e192c6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:12.708055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1277/2562] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:12 2022] DELETE /identity/v3/users/1f8f8fd996ab4515a3df0b726e192c6e => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:12.712868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:12.713455 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:12.713741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:12.737030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:12.738663 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:12.822541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1286/2563] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:12.837047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:12.838646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:12.959688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:12.972239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd0038-3011-4519-98bc-955c8700279c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:12.980553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:12.983501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:12.983501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:12.983501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:13.001258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:13.003855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:13.033193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1278/2564] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:13.174525 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:13.176044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:13.290719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6862ef-0680-45f4-87ac-b02310eb5eb3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:13.308718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:13.309609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:13.310010 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:13.310441 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:13.313221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:13.333889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:13.337111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:13.361821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1287/2565] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:13.392509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:13.394621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:13.416649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc1ac1c-ddd4-418c-96dc-d084f5cdf904 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:13.446188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:13.447474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:13.448125 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:13.448663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] PATH_INFO: `/v3/users/4b57f9679e65450b9d97b0ce893fd6bd` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:13.450603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b57f9679e65450b9d97b0ce893fd6bd)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:13.455442 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:13.916450 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b57f9679e65450b9d97b0ce893fd6bd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.064606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b57f9679e65450b9d97b0ce893fd6bd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.065692 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b57f9679e65450b9d97b0ce893fd6bd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.099793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b57f9679e65450b9d97b0ce893fd6bd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.106952 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b57f9679e65450b9d97b0ce893fd6bd'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.127119 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1279/2566] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:13 2022] DELETE /identity/v3/users/4b57f9679e65450b9d97b0ce893fd6bd => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:14.190236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:14.194165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:14.248290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2a281-5bbd-4740-80af-4b154dc107e3 service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:14.349618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:14.350407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:14.350682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:14.350994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] PATH_INFO: `/v3/projects/3bdeca1b6442487d9988300237ab9dde` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:14.354386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bdeca1b6442487d9988300237ab9dde)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:14.357108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:14.369119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:14.505734 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bdeca1b6442487d9988300237ab9dde', 'request_id': 'req-186e1a27-c08b-4441-99b4-3a4a846589a0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.508170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:14.509879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:14.517305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bdeca1b6442487d9988300237ab9dde', 'request_id': 'req-186e1a27-c08b-4441-99b4-3a4a846589a0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.613691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b05179-bbba-4248-9445-46b45099b9a9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:14.630767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bdeca1b6442487d9988300237ab9dde', 'request_id': 'req-186e1a27-c08b-4441-99b4-3a4a846589a0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.652413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] The token cache is being invalidate because project 3bdeca1b6442487d9988300237ab9dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:14.652625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.653537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:14.655675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1288/2567] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:14 2022] DELETE /identity/v3/projects/3bdeca1b6442487d9988300237ab9dde => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:14.657789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:14.659339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:14.748230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:14.785201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:14.786388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:14.786920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:14.787524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:14.797014 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:14.835445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e1a27-c08b-4441-99b4-3a4a846589a0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:14.854839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:14.856367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:14.856883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:14.857513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] PATH_INFO: `/v3/projects/72e1d7dc4f534a68a766568ee999ab86` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:14.865446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e1d7dc4f534a68a766568ee999ab86)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:14.869217 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:14.981904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:14.985906 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:15.012965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1280/2568] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:15.018505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:15.018505 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:15.035706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455744c9-8bac-4da0-943b-3144c49d77e5 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:15.076131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:15.077223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:15.077636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:15.078076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] PATH_INFO: `/v3/users/35985400fbce483d9fc3da110e99f2ee` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:15.081943 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] RBAC: Authorizing `identity:delete_user(user_id=35985400fbce483d9fc3da110e99f2ee)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:15.083710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:15.085695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e1d7dc4f534a68a766568ee999ab86', 'request_id': 'req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.093973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e1d7dc4f534a68a766568ee999ab86', 'request_id': 'req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.213820 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e1d7dc4f534a68a766568ee999ab86', 'request_id': 'req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.236154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] The token cache is being invalidate because project 72e1d7dc4f534a68a766568ee999ab86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:15.236802 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.237989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3cea337e-3c33-40f5-9dc1-fae8bae4fa60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.240391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1289/2569] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:14 2022] DELETE /identity/v3/projects/72e1d7dc4f534a68a766568ee999ab86 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:15.247746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2258e5-d949-4e37-b426-d967192c99b7 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:15.247746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2258e5-d949-4e37-b426-d967192c99b7 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:15.247746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2258e5-d949-4e37-b426-d967192c99b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:15.268931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7a2258e5-d949-4e37-b426-d967192c99b7 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:15.270594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7a2258e5-d949-4e37-b426-d967192c99b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:15.322807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:15.394212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35985400fbce483d9fc3da110e99f2ee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.407024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1290/2570] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:15.426837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d3d3-af30-4481-bf36-d7f4c814181f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:15.427283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d3d3-af30-4481-bf36-d7f4c814181f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:15.427693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717d3d3-af30-4481-bf36-d7f4c814181f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:15.452109 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c717d3d3-af30-4481-bf36-d7f4c814181f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:15.454620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c717d3d3-af30-4481-bf36-d7f4c814181f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:15.468807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1291/2571] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:15.472819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717d3d3-af30-4481-bf36-d7f4c814181f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:15.491127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717d3d3-af30-4481-bf36-d7f4c814181f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:15.504945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:15.505194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35985400fbce483d9fc3da110e99f2ee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.505891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:15.506081 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35985400fbce483d9fc3da110e99f2ee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.506345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:15.506727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:15.507567 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:15.508140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:15.510225 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:15.526530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1292/2572] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:31:15.532906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:15.535317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:15.550079 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35985400fbce483d9fc3da110e99f2ee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.550835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35985400fbce483d9fc3da110e99f2ee'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:15.552152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d322932-e074-40c5-8294-bfc64af7de65 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:15.557905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:15.559013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:15.559427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:15.559985 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:15.561055 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:15.564268 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:15.568047 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1281/2573] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:15 2022] DELETE /identity/v3/users/35985400fbce483d9fc3da110e99f2ee => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:15.673239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1293/2574] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:15 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:15.674934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:15.778364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849550a-0e4f-49a7-a83d-7dceac3c028b admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:15.797604 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:15.885552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:15.886685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:15.887333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:15.887876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:15.888783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:15.892453 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:16.029326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1282/2575] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:15 2022] POST /identity/v3/users => generated 293 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:16.033598 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:16.046804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eeaf21-3b3d-48fc-9927-60a981bebd51 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:16.058167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:16.059399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.059728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.062878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.062878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:16.063650 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:16.082437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1294/2576] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:16.101293 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:16.110981 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896924eb-7f44-43df-96da-7dc07a649b6a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:16.116916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:16.117654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.117968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.118217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.118947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:16.120553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:16.133702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1283/2577] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:16.138417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:16.158894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984e09e-b3fa-456a-8fa3-e2a028f25f29 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:16.165236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16725f-970a-423a-8ed4-3837793ef452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:16.166506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16725f-970a-423a-8ed4-3837793ef452 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.166862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16725f-970a-423a-8ed4-3837793ef452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.167235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16725f-970a-423a-8ed4-3837793ef452 admin admin] PATH_INFO: `/v3/projects/4be928d4b1f84aa19fc5b1cea42b74ff/users/8eebfb25d6a54990bc4ec7ecb97d19a8/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.191752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16725f-970a-423a-8ed4-3837793ef452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be928d4b1f84aa19fc5b1cea42b74ff, user_id=8eebfb25d6a54990bc4ec7ecb97d19a8, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:16.195484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16725f-970a-423a-8ed4-3837793ef452 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:16.370924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:16.372797 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:16.388034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9ee4b2-eeee-4423-ae9b-a418511446b8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:16.394432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:16.399391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.399391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.399391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] PATH_INFO: `/v3/projects/5d0ed82b60f84c7485586e49e319568e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.399391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d0ed82b60f84c7485586e49e319568e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:16.400040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:16.462613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1295/2578] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:16 2022] PUT /identity/v3/projects/4be928d4b1f84aa19fc5b1cea42b74ff/users/8eebfb25d6a54990bc4ec7ecb97d19a8/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:16.475063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.475362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.475716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.511129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] MFA Rules not processed for user `8eebfb25d6a54990bc4ec7ecb97d19a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:16.512353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:16.580361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d0ed82b60f84c7485586e49e319568e', 'request_id': 'req-6c781621-e730-4cba-9113-bfccccba6265'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:16.596332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d0ed82b60f84c7485586e49e319568e', 'request_id': 'req-6c781621-e730-4cba-9113-bfccccba6265'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:16.613061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1296/2579] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:16.620890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:16.625213 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:16.685312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:16.699256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d0ed82b60f84c7485586e49e319568e', 'request_id': 'req-6c781621-e730-4cba-9113-bfccccba6265'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:16.730501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] The token cache is being invalidate because project 5d0ed82b60f84c7485586e49e319568e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:16.730832 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:16.731017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02c9b4-c165-4848-a1da-4cbb98502aa9 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:16.731710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-6c781621-e730-4cba-9113-bfccccba6265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:16.733823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1284/2580] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:16 2022] DELETE /identity/v3/projects/5d0ed82b60f84c7485586e49e319568e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:16.740168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1906434-a2d9-49c7-ae1d-7046e9bf79f2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.740473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1906434-a2d9-49c7-ae1d-7046e9bf79f2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.740730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1906434-a2d9-49c7-ae1d-7046e9bf79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.770662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a1906434-a2d9-49c7-ae1d-7046e9bf79f2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:16.772006 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1906434-a2d9-49c7-ae1d-7046e9bf79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:16.835801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:16.837343 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.837848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.838287 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.840582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:16.932831 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1285/2581] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:16.935057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b663c4-4567-43de-b7d4-9d39c031d7f3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:16.935350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b663c4-4567-43de-b7d4-9d39c031d7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:16.935702 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b663c4-4567-43de-b7d4-9d39c031d7f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:16.948453 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:16.950230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:16.966152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e0b663c4-4567-43de-b7d4-9d39c031d7f3 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:16.967247 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e0b663c4-4567-43de-b7d4-9d39c031d7f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:16.972780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1297/2582] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:17.000129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1286/2583] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:17.006365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:17.018836 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bbd06-d24f-4c27-b9e5-60b008f4e922 service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:17.024312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:17.025394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:17.026076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:17.026575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:17.027625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:17.028132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:17.030030 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:17.051549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1298/2584] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:31:17.055853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b663c4-4567-43de-b7d4-9d39c031d7f3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:17.065364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b663c4-4567-43de-b7d4-9d39c031d7f3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:17.081056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:17.081056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:17.081056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:17.081056 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:17.082617 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:17.090225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:17.113254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:17.236134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1287/2585] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:17 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:17.240486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:17.252922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89070f5e-e842-4685-9cae-3b0638c2ac74 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:17.406372 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:17.408219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:17.408629 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:17.409036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:17.409962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:17.412640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:17.423134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:17.549848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1299/2586] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:17 2022] POST /identity/v3/users => generated 288 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:17.554283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:17.575541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc08e-9e75-4223-8e3f-b193792a9cb9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:17.583425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:17.585670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:17.585670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:17.585670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:17.594650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:17.601311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:17.616942 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1288/2587] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:17.621154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:17.641784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aab4b0-defd-4e9c-98e8-76ea242960c9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:17.648902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d350b-33a2-430b-94c6-a8f39e11f021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:17.649833 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d350b-33a2-430b-94c6-a8f39e11f021 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:17.650128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d350b-33a2-430b-94c6-a8f39e11f021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:17.650414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d350b-33a2-430b-94c6-a8f39e11f021 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:17.651851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d350b-33a2-430b-94c6-a8f39e11f021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:17.657359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d350b-33a2-430b-94c6-a8f39e11f021 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:17.678725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1300/2588] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:17.683465 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:17.705663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5679c7c8-24c5-4f6a-a1d9-e566b7084200 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:17.711244 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:17.713754 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:17.714089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:17.714338 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] PATH_INFO: `/v3/projects/bb30ca97924e4527866a5d6c4934330f/users/7c66b2fd0f564321830a461c7c4b0196/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:17.752597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb30ca97924e4527866a5d6c4934330f, user_id=7c66b2fd0f564321830a461c7c4b0196, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:17.755772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:17.886987 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1289/2589] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:17 2022] PUT /identity/v3/projects/bb30ca97924e4527866a5d6c4934330f/users/7c66b2fd0f564321830a461c7c4b0196/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:17.892966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27c6e-f7c2-41ce-9f9a-b38a84bcf12b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:17.893329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27c6e-f7c2-41ce-9f9a-b38a84bcf12b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:17.893564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b27c6e-f7c2-41ce-9f9a-b38a84bcf12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:17.933752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-e1b27c6e-f7c2-41ce-9f9a-b38a84bcf12b None None] MFA Rules not processed for user `7c66b2fd0f564321830a461c7c4b0196`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:17.935403 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e1b27c6e-f7c2-41ce-9f9a-b38a84bcf12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:18.096911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1301/2590] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:18.102037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:18.205478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f75ce9a-fa0f-4c65-b7d6-a61cd1c3d076 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:18.215395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:18.215395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:18.215758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:18.216425 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:18.221991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:18.221991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:18.365102 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1290/2591] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:18 2022] POST /identity/v3/projects => generated 375 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:18.369489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27c6e-f7c2-41ce-9f9a-b38a84bcf12b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:18.384352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b27c6e-f7c2-41ce-9f9a-b38a84bcf12b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:18.472677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:18.473606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:18.474016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:18.474506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:18.475592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:18.477907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:18.575788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1302/2592] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:18 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:31:18.579332 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:18.598175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13872a-6826-4470-896b-898a8bd378fc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:18.615878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:18.616571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:18.616858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:18.617165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:18.618019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:18.620126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:18.654059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1291/2593] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:18.654435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:18.666664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c6a8-f3a7-40fd-a31c-90157a2f05bb admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:18.673896 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:18.675295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:18.675626 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:18.676303 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] PATH_INFO: `/v3/projects/e23d6ba9dbe14f5fbbe9610db6b0b566/users/b5d742b1fa454fc78c020ff854b694a3/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:18.707271 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23d6ba9dbe14f5fbbe9610db6b0b566, user_id=b5d742b1fa454fc78c020ff854b694a3, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:18.710556 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:18.798338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1303/2594] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:18 2022] PUT /identity/v3/projects/e23d6ba9dbe14f5fbbe9610db6b0b566/users/b5d742b1fa454fc78c020ff854b694a3/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:18.802579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:18.815257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69e9e3-af35-4ab9-9bb8-48ca95ebc952 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:18.905197 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec8d63-9de8-446f-be0e-5a8b6554abb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:18.906154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8d63-9de8-446f-be0e-5a8b6554abb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:18.906539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8d63-9de8-446f-be0e-5a8b6554abb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:18.907312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec8d63-9de8-446f-be0e-5a8b6554abb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:18.908926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8d63-9de8-446f-be0e-5a8b6554abb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:18.914400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec8d63-9de8-446f-be0e-5a8b6554abb0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:18.927652 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1292/2595] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:18.935279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:18.955362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6fe625-28f8-41f9-b9f5-32c21dcdd5cc admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:18.967718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:18.968369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:18.968765 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:18.969309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] PATH_INFO: `/v3/projects/e23d6ba9dbe14f5fbbe9610db6b0b566/users/b5d742b1fa454fc78c020ff854b694a3/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:18.973411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e23d6ba9dbe14f5fbbe9610db6b0b566, user_id=b5d742b1fa454fc78c020ff854b694a3, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:18.978728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:18.996707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1304/2596] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:18 2022] PUT /identity/v3/projects/e23d6ba9dbe14f5fbbe9610db6b0b566/users/b5d742b1fa454fc78c020ff854b694a3/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:19.011642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cabb54-a70c-408a-8880-e4489dcbedc2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:19.012579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cabb54-a70c-408a-8880-e4489dcbedc2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:19.013215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cabb54-a70c-408a-8880-e4489dcbedc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:19.058807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-60cabb54-a70c-408a-8880-e4489dcbedc2 None None] MFA Rules not processed for user `b5d742b1fa454fc78c020ff854b694a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:19.060124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-60cabb54-a70c-408a-8880-e4489dcbedc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:19.075183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:19.313216 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1293/2597] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:19.349750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:19.351904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:19.409796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:19.498821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65410961-878d-4a65-a572-c65232d57b19 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:19.505544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:19.506483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:19.506861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:19.507256 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:19.649936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:19.651559 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:19.672873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1305/2598] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:23.861800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cabb54-a70c-408a-8880-e4489dcbedc2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:23.968916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cabb54-a70c-408a-8880-e4489dcbedc2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:23.974719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:23.975945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:23.976396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:23.977009 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] PATH_INFO: `/v3/users/7c66b2fd0f564321830a461c7c4b0196` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:23.978715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c66b2fd0f564321830a461c7c4b0196)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:23.981135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:24.065135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:24.066686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:24.084317 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ddd8f-8c1f-491c-ab07-171692ab788a service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:24.092301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:24.094570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:24.095069 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:24.095565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] PATH_INFO: `/v3/users/8eebfb25d6a54990bc4ec7ecb97d19a8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:24.097898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eebfb25d6a54990bc4ec7ecb97d19a8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:24.101774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:24.516661 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c66b2fd0f564321830a461c7c4b0196'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.531309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eebfb25d6a54990bc4ec7ecb97d19a8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.558202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eebfb25d6a54990bc4ec7ecb97d19a8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.571046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eebfb25d6a54990bc4ec7ecb97d19a8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.618996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c66b2fd0f564321830a461c7c4b0196'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.619719 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c66b2fd0f564321830a461c7c4b0196'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.645898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c66b2fd0f564321830a461c7c4b0196'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.646824 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f5d6bae-5314-4a2c-b822-9d6292bcdb14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c66b2fd0f564321830a461c7c4b0196'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.671938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eebfb25d6a54990bc4ec7ecb97d19a8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.673230 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4149f51c-db16-4710-aeec-d4173b49487c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eebfb25d6a54990bc4ec7ecb97d19a8'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:24.683603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1306/2599] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:24 2022] DELETE /identity/v3/users/8eebfb25d6a54990bc4ec7ecb97d19a8 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:24.693352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:24.694087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:24.694877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:24.704544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1294/2600] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:23 2022] DELETE /identity/v3/users/7c66b2fd0f564321830a461c7c4b0196 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:24.715029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:24.715631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:24.717379 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:24.724566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:24.726526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:24.772182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:24.774375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:24.803646 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:24.844412 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1307/2601] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:24.848893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:24.867227 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:24.870653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:24.913036 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1295/2602] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:24.925582 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:24.927413 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:25.028185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3657f4-83fb-4850-9783-832103942bc6 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:25.034923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:25.036058 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:25.036423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:25.036766 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:25.053122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:25.054982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:25.067028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1308/2603] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:25.069188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b7a4a3-0f6f-4645-a078-5592ff89b95a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:25.075944 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:25.077259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:25.077991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:25.078288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:25.099050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:25.112553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:25.118996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1296/2604] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:25.729922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:25.734997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:25.758666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cf94e6-08ff-46c9-a02d-2823e95de034 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:25.764655 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:25.765719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:25.769543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:25.769543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] PATH_INFO: `/v3/projects/bb30ca97924e4527866a5d6c4934330f` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:25.769543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb30ca97924e4527866a5d6c4934330f)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:25.771298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:25.806372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:25.808691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:25.829153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9a708-3edf-4909-81ed-7607264bfc18 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:25.833640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:25.834877 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:25.835869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:25.835869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] PATH_INFO: `/v3/projects/4be928d4b1f84aa19fc5b1cea42b74ff` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:25.837488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be928d4b1f84aa19fc5b1cea42b74ff)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:25.839135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:25.991107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb30ca97924e4527866a5d6c4934330f', 'request_id': 'req-47307d65-e531-4c27-b768-e5e1cffc1ba0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:25.997082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb30ca97924e4527866a5d6c4934330f', 'request_id': 'req-47307d65-e531-4c27-b768-e5e1cffc1ba0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.018461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be928d4b1f84aa19fc5b1cea42b74ff', 'request_id': 'req-22f36e8e-09d9-4d52-b8bf-51cabce22a64'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.024799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be928d4b1f84aa19fc5b1cea42b74ff', 'request_id': 'req-22f36e8e-09d9-4d52-b8bf-51cabce22a64'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.065122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb30ca97924e4527866a5d6c4934330f', 'request_id': 'req-47307d65-e531-4c27-b768-e5e1cffc1ba0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.081457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] The token cache is being invalidate because project bb30ca97924e4527866a5d6c4934330f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:26.082127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.083272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.086128 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1309/2605] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:25 2022] DELETE /identity/v3/projects/bb30ca97924e4527866a5d6c4934330f => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:26.090541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:26.092051 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:26.171006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47307d65-e531-4c27-b768-e5e1cffc1ba0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:26.190958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:26.201724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be928d4b1f84aa19fc5b1cea42b74ff', 'request_id': 'req-22f36e8e-09d9-4d52-b8bf-51cabce22a64'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.214966 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] The token cache is being invalidate because project 4be928d4b1f84aa19fc5b1cea42b74ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:26.221470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.221470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-22f36e8e-09d9-4d52-b8bf-51cabce22a64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.221470 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1297/2606] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:25 2022] DELETE /identity/v3/projects/4be928d4b1f84aa19fc5b1cea42b74ff => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:26.224065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fccc-936e-461a-8b5c-b0a2cfee8c05 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:26.224418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fccc-936e-461a-8b5c-b0a2cfee8c05 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:26.224736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97fccc-936e-461a-8b5c-b0a2cfee8c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:26.240346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:26.242116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:26.242406 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:26.242686 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] PATH_INFO: `/v3/users/b5d742b1fa454fc78c020ff854b694a3` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:26.244053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5d742b1fa454fc78c020ff854b694a3)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:26.245018 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5a97fccc-936e-461a-8b5c-b0a2cfee8c05 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:26.252205 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:26.252407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5a97fccc-936e-461a-8b5c-b0a2cfee8c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:26.257659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1298/2607] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:26.266548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ccb0-bb05-400c-8763-c35791460e70 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:26.267098 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ccb0-bb05-400c-8763-c35791460e70 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:26.267571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086ccb0-bb05-400c-8763-c35791460e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:26.292487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a086ccb0-bb05-400c-8763-c35791460e70 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:26.292487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a086ccb0-bb05-400c-8763-c35791460e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:26.303488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1299/2608] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:26.307668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ccb0-bb05-400c-8763-c35791460e70 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:26.320430 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086ccb0-bb05-400c-8763-c35791460e70 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:26.326635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:26.328264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:26.328555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:26.328960 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:26.329758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:26.330227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:26.332041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:26.345686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1300/2609] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:31:26.350509 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:26.362176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c385-4fd3-4569-837d-b700a870821a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:26.368371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:26.368371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:26.368371 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:26.368872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:26.369248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:26.371634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:26.491357 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5d742b1fa454fc78c020ff854b694a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.497556 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1301/2610] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:26 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:31:26.498635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:26.501336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:26.510489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5d742b1fa454fc78c020ff854b694a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.520023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:26.524073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5d742b1fa454fc78c020ff854b694a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.593115 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a56f5-80cb-4d0c-9f1a-8d1d3ace27fc admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:26.597656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:26.598404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:26.598819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:26.599256 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:26.602204 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5d742b1fa454fc78c020ff854b694a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.602394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:26.603433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5d742b1fa454fc78c020ff854b694a3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:26.617301 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1310/2611] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:26 2022] DELETE /identity/v3/users/b5d742b1fa454fc78c020ff854b694a3 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:26.620531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:26.620704 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:26.700068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:26.701836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:26.715666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1302/2612] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:26.717127 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874477f-356e-45d4-a24b-90c2e8dcfe2e admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:26.725767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:26.726605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:26.728966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:26.728966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:26.728966 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:26.731862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:26.924801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1311/2613] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:26 2022] POST /identity/v3/users => generated 289 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:26.929586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.071267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ad88c-576b-406b-bf97-d4898d1641d4 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.079605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.080515 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.080937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.081412 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.082537 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.084184 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.098489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1303/2614] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:26 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:27.102432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.130171 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d59098-e8a0-4ca2-9f9d-cc2bcc2d3f8f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.133282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9623c45-c9b0-44a4-b5e8-89e3dce7063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.134238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623c45-c9b0-44a4-b5e8-89e3dce7063f admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.134678 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623c45-c9b0-44a4-b5e8-89e3dce7063f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.134970 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9623c45-c9b0-44a4-b5e8-89e3dce7063f admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.135725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623c45-c9b0-44a4-b5e8-89e3dce7063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.137451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9623c45-c9b0-44a4-b5e8-89e3dce7063f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.153111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1312/2615] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:27.158304 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.174109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838afd0-00e8-4719-b6fb-ca7bfdd6e937 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.179895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.180815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.181145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.181422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] PATH_INFO: `/v3/projects/d4f2244d8ffa42c1b03c489638237cc3/users/1fbf59e0cd64426fb465c21a9320ad6b/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.202741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f2244d8ffa42c1b03c489638237cc3, user_id=1fbf59e0cd64426fb465c21a9320ad6b, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.205639 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.296579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1304/2616] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:27 2022] PUT /identity/v3/projects/d4f2244d8ffa42c1b03c489638237cc3/users/1fbf59e0cd64426fb465c21a9320ad6b/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:27.312553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cbde2-7e73-448d-924f-f6a1b617bc37 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.312553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cbde2-7e73-448d-924f-f6a1b617bc37 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.312857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83cbde2-7e73-448d-924f-f6a1b617bc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.344104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.346089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:27.358781 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f83cbde2-7e73-448d-924f-f6a1b617bc37 None None] MFA Rules not processed for user `1fbf59e0cd64426fb465c21a9320ad6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:27.362046 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f83cbde2-7e73-448d-924f-f6a1b617bc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:27.379148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:27.409386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:27.453124 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1313/2617] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:27.453456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47f124-6e82-4565-8edd-e634c63d1910 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.459188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.466233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.466233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.466620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cbde2-7e73-448d-924f-f6a1b617bc37 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.466794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] PATH_INFO: `/v3/projects/e23d6ba9dbe14f5fbbe9610db6b0b566` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.466794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e23d6ba9dbe14f5fbbe9610db6b0b566)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.466794 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.479980 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83cbde2-7e73-448d-924f-f6a1b617bc37 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.489038 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.490192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.490702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.491197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.492499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.496361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.658767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1314/2618] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:27 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:27.660592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.669779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e23d6ba9dbe14f5fbbe9610db6b0b566', 'request_id': 'req-c58244bf-015f-47b2-888e-b8edbc6b3a40'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:27.677533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e23d6ba9dbe14f5fbbe9610db6b0b566', 'request_id': 'req-c58244bf-015f-47b2-888e-b8edbc6b3a40'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:27.751810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aca67-bb68-4613-b439-301e049aed8d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.756877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.757613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.757897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.758202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.758911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.761018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.772517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e23d6ba9dbe14f5fbbe9610db6b0b566', 'request_id': 'req-c58244bf-015f-47b2-888e-b8edbc6b3a40'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:27.786917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] The token cache is being invalidate because project e23d6ba9dbe14f5fbbe9610db6b0b566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:27.787226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:27.787991 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c58244bf-015f-47b2-888e-b8edbc6b3a40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:27.789656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1305/2619] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:27 2022] DELETE /identity/v3/projects/e23d6ba9dbe14f5fbbe9610db6b0b566 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:27.795209 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13828-5ca3-4f7b-8360-0240af4bcca1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.795498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13828-5ca3-4f7b-8360-0240af4bcca1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.795777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf13828-5ca3-4f7b-8360-0240af4bcca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.817325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6cf13828-5ca3-4f7b-8360-0240af4bcca1 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:27.818566 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6cf13828-5ca3-4f7b-8360-0240af4bcca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:27.827157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1306/2620] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:27.836774 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc1b4-f891-4209-ba32-682afa0313e4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.837137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc1b4-f891-4209-ba32-682afa0313e4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.837421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc1b4-f891-4209-ba32-682afa0313e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.867335 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a54fc1b4-f891-4209-ba32-682afa0313e4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:27.869670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a54fc1b4-f891-4209-ba32-682afa0313e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:27.879235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1315/2621] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:27 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:27.881432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.884138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:27.893850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1307/2622] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:27.895677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc1b4-f891-4209-ba32-682afa0313e4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.903164 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3064958-721c-4a80-bdf2-3adc322fed33 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.909763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.910548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.913725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.913725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.913725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.913725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.914937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc1b4-f891-4209-ba32-682afa0313e4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.924002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.925380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.925922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.926397 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.927907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1316/2623] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:27 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:31:27.928031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:27.928429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.931955 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.932437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.945739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a9a395-2381-4142-a6a3-db0db7de6a63 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.951191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.952751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.953871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.953871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] PATH_INFO: `/v3/projects/96207ffba84c4a82a5df4f9d7bfae003/users/5385b8af57cb47b7a5046f11073bed4c/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.957381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1308/2624] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:31:27.962352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:27.981408 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3818cc7-ea32-4e0f-b6c2-e22d4d955df2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:27.988515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=96207ffba84c4a82a5df4f9d7bfae003, user_id=5385b8af57cb47b7a5046f11073bed4c, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:27.993606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:27.993881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:27.994802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:27.995609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:27.996191 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:27.997210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.001182 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.072419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1317/2625] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:27 2022] PUT /identity/v3/projects/96207ffba84c4a82a5df4f9d7bfae003/users/5385b8af57cb47b7a5046f11073bed4c/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:28.076652 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.115003 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1309/2626] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:27 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:28.121559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.159653 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:28.198220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262f413-cb83-4227-a220-a1072acc85ca admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.272278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a1099-376e-44ab-8350-d61daa8f124d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.280021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37541a0b-8cd5-4d37-a9c2-3090713f2c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.281895 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37541a0b-8cd5-4d37-a9c2-3090713f2c01 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.282658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37541a0b-8cd5-4d37-a9c2-3090713f2c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.283042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37541a0b-8cd5-4d37-a9c2-3090713f2c01 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.283982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37541a0b-8cd5-4d37-a9c2-3090713f2c01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.286417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37541a0b-8cd5-4d37-a9c2-3090713f2c01 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.320417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.321170 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.321479 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.321788 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.322657 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.324387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.337941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1318/2627] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:31:28.342386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.354654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a25d2a-0784-4d42-ae9e-1a43de402fe0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.361221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.362133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.362467 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.362724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] PATH_INFO: `/v3/projects/96207ffba84c4a82a5df4f9d7bfae003/users/5385b8af57cb47b7a5046f11073bed4c/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.364843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96207ffba84c4a82a5df4f9d7bfae003, user_id=5385b8af57cb47b7a5046f11073bed4c, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.367665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.381132 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:28.381353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1319/2628] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:28 2022] PUT /identity/v3/projects/96207ffba84c4a82a5df4f9d7bfae003/users/5385b8af57cb47b7a5046f11073bed4c/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:28.387938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1310/2629] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:28 2022] POST /identity/v3/users => generated 288 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:31:28.393783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.394538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.395458 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.395822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.439383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] MFA Rules not processed for user `5385b8af57cb47b7a5046f11073bed4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:28.441493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:28.488096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9fb6f-980f-4c62-b34e-2d3c0f571894 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.493851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.494451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.494732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.495021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.495755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.497544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.514000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1320/2630] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:28.518255 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.529876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11816e84-f9ea-48c7-93c3-b4bbad55a793 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.536106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.537750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.537750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.537750 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.538506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.540345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.556954 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1321/2631] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:28.567233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.579466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36227a3-c39d-4f7f-8577-d81f8c4fa280 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.585386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffe2978-79f9-4abd-aee1-cbc8c354682e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.586538 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2978-79f9-4abd-aee1-cbc8c354682e admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.586923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2978-79f9-4abd-aee1-cbc8c354682e admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.587305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffe2978-79f9-4abd-aee1-cbc8c354682e admin admin] PATH_INFO: `/v3/projects/e4066af67737412c8c8c9c916b2467b8/users/1559dc026d73463d9c38c73deb387df9/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.588343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1311/2632] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:28.603631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.606420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:28.610674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe2978-79f9-4abd-aee1-cbc8c354682e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4066af67737412c8c8c9c916b2467b8, user_id=1559dc026d73463d9c38c73deb387df9, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.625237 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffe2978-79f9-4abd-aee1-cbc8c354682e admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.710027 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fbae1-e29a-4d11-ad11-3034b46f7b19 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.716097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.717231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.719401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.719800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.729902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1322/2633] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:28 2022] PUT /identity/v3/projects/e4066af67737412c8c8c9c916b2467b8/users/1559dc026d73463d9c38c73deb387df9/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:28.737769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:28.739996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:28.748499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595255-fe86-481d-b70b-6a890906e574 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.749739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595255-fe86-481d-b70b-6a890906e574 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.750371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c595255-fe86-481d-b70b-6a890906e574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.759377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1312/2634] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:28 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:28.787045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9c595255-fe86-481d-b70b-6a890906e574 None None] MFA Rules not processed for user `1559dc026d73463d9c38c73deb387df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:28.788485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9c595255-fe86-481d-b70b-6a890906e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:28.815631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:28.876257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1323/2635] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:28.887200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:28.888868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:28.902768 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc0670-e359-4984-91bc-d410c3f38fd9 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:28.983897 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce39c23-2dc7-474f-ac00-814c8c229b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:28.985921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce39c23-2dc7-474f-ac00-814c8c229b9b service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:28.986405 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce39c23-2dc7-474f-ac00-814c8c229b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:28.986766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce39c23-2dc7-474f-ac00-814c8c229b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:28.998242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce39c23-2dc7-474f-ac00-814c8c229b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:29.001029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce39c23-2dc7-474f-ac00-814c8c229b9b service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:29.011972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1313/2636] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:29.494346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c595255-fe86-481d-b70b-6a890906e574 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:29.578108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c595255-fe86-481d-b70b-6a890906e574 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:29.583821 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:29.584951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:29.585235 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:29.585476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] PATH_INFO: `/v3/users/1fbf59e0cd64426fb465c21a9320ad6b` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:29.586800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fbf59e0cd64426fb465c21a9320ad6b)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:29.588906 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:29.796216 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fbf59e0cd64426fb465c21a9320ad6b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:29.823160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fbf59e0cd64426fb465c21a9320ad6b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:29.834379 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fbf59e0cd64426fb465c21a9320ad6b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:29.906258 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fbf59e0cd64426fb465c21a9320ad6b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:29.907409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fbf59e0cd64426fb465c21a9320ad6b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:29.922683 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1324/2637] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:29 2022] DELETE /identity/v3/users/1fbf59e0cd64426fb465c21a9320ad6b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:29.924529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:29.925085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:29.925584 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:29.966409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:29.968915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:30.009727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:30.048621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1314/2638] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:30.058863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:30.060405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:30.112524 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:30.124899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e4b41-c333-43b8-93d3-1729dfba9635 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:30.128885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:30.129595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:30.129876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:30.130155 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:30.151477 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:30.157087 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:30.180501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1325/2639] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:30.812100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:30.814826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:30.842496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4e9b-9bb5-43df-9899-fa9731392e1e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:30.850168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:30.851457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:30.851901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:30.852386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] PATH_INFO: `/v3/projects/d4f2244d8ffa42c1b03c489638237cc3` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:30.854319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f2244d8ffa42c1b03c489638237cc3)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:30.856937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:31.019614 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f2244d8ffa42c1b03c489638237cc3', 'request_id': 'req-abf04208-1194-4834-b6b1-b4a63bb81623'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.032159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f2244d8ffa42c1b03c489638237cc3', 'request_id': 'req-abf04208-1194-4834-b6b1-b4a63bb81623'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.155779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f2244d8ffa42c1b03c489638237cc3', 'request_id': 'req-abf04208-1194-4834-b6b1-b4a63bb81623'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.168790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] The token cache is being invalidate because project d4f2244d8ffa42c1b03c489638237cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:31.169159 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.169804 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.171424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1315/2640] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:30 2022] DELETE /identity/v3/projects/d4f2244d8ffa42c1b03c489638237cc3 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:31.175692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:31.194545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419fd3d-65f4-4a89-b8bc-bd52ef6cf9b8 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:31.260800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:31.261791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:31.262115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:31.262395 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] PATH_INFO: `/v3/users/5385b8af57cb47b7a5046f11073bed4c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:31.263719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5385b8af57cb47b7a5046f11073bed4c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:31.266289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:31.572495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5385b8af57cb47b7a5046f11073bed4c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.586673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5385b8af57cb47b7a5046f11073bed4c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.594197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5385b8af57cb47b7a5046f11073bed4c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.681283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5385b8af57cb47b7a5046f11073bed4c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.685059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-6eeeaa57-ffcf-499f-b986-209ba57ecf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5385b8af57cb47b7a5046f11073bed4c'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:31.694377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1326/2641] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:31 2022] DELETE /identity/v3/users/5385b8af57cb47b7a5046f11073bed4c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:32.261094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:32.262705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:32.284344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf04208-1194-4834-b6b1-b4a63bb81623 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:32.398923 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:32.403759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:32.403759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:32.403759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] PATH_INFO: `/v3/projects/96207ffba84c4a82a5df4f9d7bfae003` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:32.403759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96207ffba84c4a82a5df4f9d7bfae003)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:32.406289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:32.588220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96207ffba84c4a82a5df4f9d7bfae003', 'request_id': 'req-81b08514-cead-433f-a65f-a4d1888733f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:32.595370 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:32.596860 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96207ffba84c4a82a5df4f9d7bfae003', 'request_id': 'req-81b08514-cead-433f-a65f-a4d1888733f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:32.699628 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96207ffba84c4a82a5df4f9d7bfae003', 'request_id': 'req-81b08514-cead-433f-a65f-a4d1888733f3'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:32.722998 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] The token cache is being invalidate because project 96207ffba84c4a82a5df4f9d7bfae003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:32.723356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:32.724302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-81b08514-cead-433f-a65f-a4d1888733f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:32.726053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1316/2642] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:32 2022] DELETE /identity/v3/projects/96207ffba84c4a82a5df4f9d7bfae003 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:32.731852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595dc2c-3538-48dd-b5fb-1be27ee8819d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:32.732362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595dc2c-3538-48dd-b5fb-1be27ee8819d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:32.732458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595dc2c-3538-48dd-b5fb-1be27ee8819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:32.752354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-1595dc2c-3538-48dd-b5fb-1be27ee8819d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:32.755198 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1595dc2c-3538-48dd-b5fb-1be27ee8819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:32.824017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1327/2643] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:32.833638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759b4d-76cb-4af3-8111-aa79026af9ae None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:32.833638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759b4d-76cb-4af3-8111-aa79026af9ae None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:32.833638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae759b4d-76cb-4af3-8111-aa79026af9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:32.854366 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ae759b4d-76cb-4af3-8111-aa79026af9ae None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:32.855580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ae759b4d-76cb-4af3-8111-aa79026af9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:32.863994 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1317/2644] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:32.870560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595dc2c-3538-48dd-b5fb-1be27ee8819d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:32.880027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:32.891426 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595dc2c-3538-48dd-b5fb-1be27ee8819d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:32.897974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:32.898962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:32.899676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:32.900107 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:32.901084 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:32.901848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:32.904616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:32.921422 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1328/2645] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:31:32.928756 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae759b4d-76cb-4af3-8111-aa79026af9ae None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:32.946428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae759b4d-76cb-4af3-8111-aa79026af9ae None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:32.953287 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:32.953971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:32.954268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:32.954547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:32.955278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:32.957226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:33.056664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1318/2646] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:32 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:33.062586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:33.081247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9ed95-4d61-444f-9c58-af8c72c09fb6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:33.149079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:33.149762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.150052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.150330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.151024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:33.152942 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:33.299541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1329/2647] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:33 2022] POST /identity/v3/users => generated 292 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:33.304456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:33.316402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5252e-86a2-44d2-8df2-301a762c745e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:33.321424 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:33.322356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.323175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.323175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.326695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:33.331770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:33.342401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1319/2648] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:33.347464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:33.365933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5cbc2a-2746-4bc8-97e6-a7dc1c412643 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:33.378207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8618ba0-2e4e-4127-a34c-5a214a0f7b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:33.379345 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8618ba0-2e4e-4127-a34c-5a214a0f7b4a admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.379830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8618ba0-2e4e-4127-a34c-5a214a0f7b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.380360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8618ba0-2e4e-4127-a34c-5a214a0f7b4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.381689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8618ba0-2e4e-4127-a34c-5a214a0f7b4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:33.384369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8618ba0-2e4e-4127-a34c-5a214a0f7b4a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:33.404144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1330/2649] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:33.408771 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:33.419707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6bbeb-5868-484e-b57e-f1c531936331 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:33.425123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:33.426061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.426544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.429504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] PATH_INFO: `/v3/projects/ed833d70319e447e96471a1fe0309c97/users/826f034fdc1f40e99eca59b19653f71d/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.444544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed833d70319e447e96471a1fe0309c97, user_id=826f034fdc1f40e99eca59b19653f71d, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:33.447392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:33.540656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1320/2650] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:33 2022] PUT /identity/v3/projects/ed833d70319e447e96471a1fe0309c97/users/826f034fdc1f40e99eca59b19653f71d/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:33.554763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1df156-6cc8-4c0f-bb97-1fa19b297cca None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.555281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1df156-6cc8-4c0f-bb97-1fa19b297cca None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.555808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1df156-6cc8-4c0f-bb97-1fa19b297cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.588254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-ed1df156-6cc8-4c0f-bb97-1fa19b297cca None None] MFA Rules not processed for user `826f034fdc1f40e99eca59b19653f71d`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:33.589635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-ed1df156-6cc8-4c0f-bb97-1fa19b297cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:33.666196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1331/2651] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:33.679250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:33.681195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:33.777454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb7b4b-8c82-4dae-b729-d9391b905298 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:33.784299 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498cd234-22eb-4516-ba52-f7ce91095ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:33.785696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd234-22eb-4516-ba52-f7ce91095ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.787542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd234-22eb-4516-ba52-f7ce91095ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.788394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498cd234-22eb-4516-ba52-f7ce91095ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.804555 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cd234-22eb-4516-ba52-f7ce91095ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:33.807255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498cd234-22eb-4516-ba52-f7ce91095ad0 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:33.819693 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1321/2652] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:33.842034 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1df156-6cc8-4c0f-bb97-1fa19b297cca None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:33.895766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87b8b-1b50-4ebb-a103-86391ae0162b None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.896826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87b8b-1b50-4ebb-a103-86391ae0162b None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.897300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87b8b-1b50-4ebb-a103-86391ae0162b None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.899937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1322/2653] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:31:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:31:33.909712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.910402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.910763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.934150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:33.934684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:33.942901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1df156-6cc8-4c0f-bb97-1fa19b297cca None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:33.955427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:33.957079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:33.957557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:33.958001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] PATH_INFO: `/v3/users/826f034fdc1f40e99eca59b19653f71d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:33.960110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] RBAC: Authorizing `identity:delete_user(user_id=826f034fdc1f40e99eca59b19653f71d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:33.969811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:33.969811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:34.036823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1323/2654] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:31:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:34.038059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:34.040233 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.060707 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608b8df-a5ae-4e03-983c-0c6e0346e8be None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:34.069919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:34.071258 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.071641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.071956 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] PATH_INFO: `/v3/users/1559dc026d73463d9c38c73deb387df9` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.073599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1559dc026d73463d9c38c73deb387df9)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:34.075729 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:34.090349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:34.229883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '826f034fdc1f40e99eca59b19653f71d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.245015 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '826f034fdc1f40e99eca59b19653f71d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.253594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '826f034fdc1f40e99eca59b19653f71d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.286019 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1559dc026d73463d9c38c73deb387df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.344259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '826f034fdc1f40e99eca59b19653f71d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.345331 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '826f034fdc1f40e99eca59b19653f71d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.356738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1332/2655] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:33 2022] DELETE /identity/v3/users/826f034fdc1f40e99eca59b19653f71d => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:34.357997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:34.361798 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.413933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1559dc026d73463d9c38c73deb387df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.415084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1559dc026d73463d9c38c73deb387df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.433691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1559dc026d73463d9c38c73deb387df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.439636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-89a39846-5cd8-458e-9f44-146040d523ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1559dc026d73463d9c38c73deb387df9'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:34.440324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877a756-d621-4aef-9881-0ead6d36930b admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:34.442318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512daf0-3c37-45f9-9daa-66b64f03b795 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:34.443018 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512daf0-3c37-45f9-9daa-66b64f03b795 service glance] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.443324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512daf0-3c37-45f9-9daa-66b64f03b795 service glance] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.443595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512daf0-3c37-45f9-9daa-66b64f03b795 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.445689 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7512daf0-3c37-45f9-9daa-66b64f03b795 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.449664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1324/2656] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:34 2022] DELETE /identity/v3/users/1559dc026d73463d9c38c73deb387df9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:34.451154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.451451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.451767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.471271 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:34.472855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.538728 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512daf0-3c37-45f9-9daa-66b64f03b795 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:34.540108 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7512daf0-3c37-45f9-9daa-66b64f03b795 service glance] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:34.555847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1333/2657] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:34.557427 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.557716 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.557999 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.579045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:34.579977 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.586384 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1325/2658] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:34.598600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:34.598600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.598771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1334/2659] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:34.615807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:34.618242 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.644191 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:34.683333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bc56f-d88c-4b61-a852-f0b7f26d24e4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:34.690225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e47d6-912b-45a0-940d-f878a95d3bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:34.691369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e47d6-912b-45a0-940d-f878a95d3bee service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.691965 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e47d6-912b-45a0-940d-f878a95d3bee service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.692395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e47d6-912b-45a0-940d-f878a95d3bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.710667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e47d6-912b-45a0-940d-f878a95d3bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:34.713769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e47d6-912b-45a0-940d-f878a95d3bee service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:34.718839 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e71e0-2ba8-4d9a-a76d-35715e9f59fd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:34.723233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:34.724024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.724203 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.724476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.733063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1326/2660] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:34.734854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:34.736334 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:34.742726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebff0d-d340-419d-9973-bc36a5e2bcbf None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.743031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebff0d-d340-419d-9973-bc36a5e2bcbf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.743365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdebff0d-d340-419d-9973-bc36a5e2bcbf None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.744941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1327/2661] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:31:34.747614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1335/2662] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:34.751085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3edf-cd40-4715-a5ae-60759dd039c3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.751422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3edf-cd40-4715-a5ae-60759dd039c3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.751732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f3edf-cd40-4715-a5ae-60759dd039c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.779054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c58f3edf-cd40-4715-a5ae-60759dd039c3 None None] MFA Rules not processed for user `aff4923457aa4be498f954c73f4d0018`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:34.780620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c58f3edf-cd40-4715-a5ae-60759dd039c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:34.789488 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1328/2663] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:31:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:34.809951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:34.822151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c385739e-1881-4f55-acc3-a9109e805be4 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:34.828076 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21dfc77-142b-44f0-8a7f-ca0edfd09456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:34.828908 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfc77-142b-44f0-8a7f-ca0edfd09456 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:34.829914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfc77-142b-44f0-8a7f-ca0edfd09456 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:34.829914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21dfc77-142b-44f0-8a7f-ca0edfd09456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:34.840409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dfc77-142b-44f0-8a7f-ca0edfd09456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:34.842104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21dfc77-142b-44f0-8a7f-ca0edfd09456 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:34.852641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1336/2664] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:35.023252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e835e-a7cb-46f6-bccf-e3c4e80cc63a None None] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:35.024177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e835e-a7cb-46f6-bccf-e3c4e80cc63a None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:35.024678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e835e-a7cb-46f6-bccf-e3c4e80cc63a None None] PATH_INFO: `/` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:35.027532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1329/2665] 10.222.0.27 () {54 vars in 921 bytes} [Mon Jul 18 06:31:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 06:31:35.040882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:35.040882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:35.040882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:35.064892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] MFA Rules not processed for user `065014e1d5984a3db142381ccc62a420`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:35.066843 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:35.157969 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1337/2666] 10.222.0.27 () {58 vars in 1018 bytes} [Mon Jul 18 06:31:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:35.173146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e835e-a7cb-46f6-bccf-e3c4e80cc63a None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:35.175870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bc9e835e-a7cb-46f6-bccf-e3c4e80cc63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:35.206104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e835e-a7cb-46f6-bccf-e3c4e80cc63a None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:35.216411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:35.216411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:35.216411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:35.216411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:35.229586 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:35.230890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:35.244705 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1330/2667] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:35.524880 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:35.526438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:35.536466 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:35.538911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:35.542140 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57febe55-45ff-4f37-95aa-ee7fe42dedf3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:35.547925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:35.549366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:35.549715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:35.550065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] PATH_INFO: `/v3/projects/ed833d70319e447e96471a1fe0309c97` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:35.552621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed833d70319e447e96471a1fe0309c97)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:35.554784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:35.573202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a321a1-0375-493c-9e96-e4cf8fbb96eb service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:35.599486 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:35.601857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:35.602362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:35.602822 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] PATH_INFO: `/v3/projects/e4066af67737412c8c8c9c916b2467b8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:35.604507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4066af67737412c8c8c9c916b2467b8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:35.607672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:35.620351 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:35.711545 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed833d70319e447e96471a1fe0309c97', 'request_id': 'req-414f89cc-0eb2-4ccc-b045-b750168ad351'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:35.722762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed833d70319e447e96471a1fe0309c97', 'request_id': 'req-414f89cc-0eb2-4ccc-b045-b750168ad351'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:35.743670 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4066af67737412c8c8c9c916b2467b8', 'request_id': 'req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:35.755152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4066af67737412c8c8c9c916b2467b8', 'request_id': 'req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:35.859342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed833d70319e447e96471a1fe0309c97', 'request_id': 'req-414f89cc-0eb2-4ccc-b045-b750168ad351'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:35.874878 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] The token cache is being invalidate because project ed833d70319e447e96471a1fe0309c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:35.875129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:35.875757 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-414f89cc-0eb2-4ccc-b045-b750168ad351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:35.877352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1338/2668] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:35 2022] DELETE /identity/v3/projects/ed833d70319e447e96471a1fe0309c97 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:35.882272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20ef9-0103-4703-9b23-9e005497abcb None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:35.882563 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20ef9-0103-4703-9b23-9e005497abcb None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:35.898315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d20ef9-0103-4703-9b23-9e005497abcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:35.906363 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-59d20ef9-0103-4703-9b23-9e005497abcb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:35.907621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-59d20ef9-0103-4703-9b23-9e005497abcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:35.925014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:35.981325 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1339/2669] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:35.991589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c278-7c1b-434c-b87c-0b2170e9ad77 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:35.992110 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c278-7c1b-434c-b87c-0b2170e9ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.018387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c278-7c1b-434c-b87c-0b2170e9ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.023152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-dd02c278-7c1b-434c-b87c-0b2170e9ad77 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:36.024411 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-dd02c278-7c1b-434c-b87c-0b2170e9ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:36.033731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1340/2670] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:36.038040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02c278-7c1b-434c-b87c-0b2170e9ad77 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.047687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02c278-7c1b-434c-b87c-0b2170e9ad77 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.053348 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.054099 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.054443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.054780 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.055616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:36.055988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.057797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.072116 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1341/2671] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:31:36.076676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.088537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36af9a8-3117-4ff0-8858-8f0178150eb0 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.094063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.094755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.095053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.095330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.096053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.098059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.120898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4066af67737412c8c8c9c916b2467b8', 'request_id': 'req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:36.129893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] The token cache is being invalidate because project e4066af67737412c8c8c9c916b2467b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:36.130168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:36.130872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c3e3ab89-072e-442a-9f5c-c44b4cdbd8d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:36.132538 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1331/2672] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:35 2022] DELETE /identity/v3/projects/e4066af67737412c8c8c9c916b2467b8 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:36.137539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503851-97ae-4b91-9b37-0826c19f6735 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.137887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503851-97ae-4b91-9b37-0826c19f6735 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.138240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1503851-97ae-4b91-9b37-0826c19f6735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.160519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-c1503851-97ae-4b91-9b37-0826c19f6735 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:36.161834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c1503851-97ae-4b91-9b37-0826c19f6735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:36.178638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1332/2673] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:36.180409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6fe6-5a24-4d56-be36-4e46ce12bd76 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.180698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6fe6-5a24-4d56-be36-4e46ce12bd76 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.181004 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b6fe6-5a24-4d56-be36-4e46ce12bd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.201836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-e38b6fe6-5a24-4d56-be36-4e46ce12bd76 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:36.203770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-e38b6fe6-5a24-4d56-be36-4e46ce12bd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:36.212343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1333/2674] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:36.216440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6fe6-5a24-4d56-be36-4e46ce12bd76 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.232303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b6fe6-5a24-4d56-be36-4e46ce12bd76 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.238759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.239444 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.239782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.240086 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.240909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:36.241252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.242922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.258247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1342/2675] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:36 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:31:36.262064 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1334/2676] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:31:36.263548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.266882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.269661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:36.287912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4902fdd-948f-4117-aff9-87ecd09e350c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.382851 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5c47c6-9301-4b17-ac7e-1430555b9c53 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.389251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.394447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.394447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.394447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.394447 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.395613 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.399681 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.400957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.401490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.401915 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.402790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.405124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.525582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1343/2677] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:36 2022] POST /identity/v3/users => generated 288 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:31:36.527473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1335/2678] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:36 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:36.531736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.533160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.548799 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26df74e-be47-49a6-a1c0-857912deb0f1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.627464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759b52b-88cd-450e-b6e7-b83964bb9823 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.636241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.636967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.637526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.637996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.639174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.643391 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.644902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.646869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.656221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.656221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.656221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.656221 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.679860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1344/2679] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:31:36.685280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.702547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837b4ed-8ea6-49b9-a2b0-e0d1cd2355a7 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.708536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.709350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.709633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.709912 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.710715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.712381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.727900 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1345/2680] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:31:36.735384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.746845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ee7a5-78c1-4eed-b507-6ded48eda4fd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.752885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3832846-f305-429a-8de2-fc3d70ae804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.754039 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3832846-f305-429a-8de2-fc3d70ae804d admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.754511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3832846-f305-429a-8de2-fc3d70ae804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.754806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3832846-f305-429a-8de2-fc3d70ae804d admin admin] PATH_INFO: `/v3/projects/8b6edeb645954ff48f740411becc41d8/users/a37f8dc76f564682b893016651461548/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.774813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3832846-f305-429a-8de2-fc3d70ae804d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6edeb645954ff48f740411becc41d8, user_id=a37f8dc76f564682b893016651461548, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.777889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3832846-f305-429a-8de2-fc3d70ae804d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.850921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1336/2681] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:36 2022] POST /identity/v3/users => generated 292 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:36.856613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.873297 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761abcea-a0b0-4fc5-9243-95442cdae551 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.880234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.880922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.881237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.881767 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.882520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.884140 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.897123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1337/2682] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:31:36.902180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.912922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a58af-fb02-45e0-b5bd-04759f7f6ab2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.918061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:36.918743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.919031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.919312 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:36.920054 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:36.921865 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:36.933899 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1338/2683] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:31:36.939473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:36.952743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04b365-044b-4e3d-bb17-875796b18a46 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:36.961102 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1346/2684] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:36 2022] PUT /identity/v3/projects/8b6edeb645954ff48f740411becc41d8/users/a37f8dc76f564682b893016651461548/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:36.963106 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:36.972791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:36.973374 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:36.973886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:37.023094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] MFA Rules not processed for user `a37f8dc76f564682b893016651461548`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:37.024469 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:37.034912 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148030ee-b1a7-4a8f-8d6c-6c8b7f6c7eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:37.036528 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148030ee-b1a7-4a8f-8d6c-6c8b7f6c7eda admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:37.036921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148030ee-b1a7-4a8f-8d6c-6c8b7f6c7eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:37.037296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148030ee-b1a7-4a8f-8d6c-6c8b7f6c7eda admin admin] PATH_INFO: `/v3/projects/4ee21eab634f41d485fb122b4fcff87c/users/38b448de92ca4f2497b82ebcf6326d37/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:37.057922 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148030ee-b1a7-4a8f-8d6c-6c8b7f6c7eda admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ee21eab634f41d485fb122b4fcff87c, user_id=38b448de92ca4f2497b82ebcf6326d37, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:37.060842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148030ee-b1a7-4a8f-8d6c-6c8b7f6c7eda admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:37.115495 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1347/2685] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:37.134614 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:37.136700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:37.143377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1339/2686] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:36 2022] PUT /identity/v3/projects/4ee21eab634f41d485fb122b4fcff87c/users/38b448de92ca4f2497b82ebcf6326d37/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:37.161127 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:37.161420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:37.161723 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:37.197996 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] MFA Rules not processed for user `38b448de92ca4f2497b82ebcf6326d37`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:37.199446 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:37.237370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b2fac-c5d8-4448-a681-a57964c7c41b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:37.311735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:37.313051 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1340/2687] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:37.316028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:37.316887 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:37.317309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:37.317949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:37.325627 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:37.328015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:37.341045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9fd08-4d95-454f-92d1-551a2732f95c None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:37.345730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01c499-231c-44de-a9af-1c0031a117f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:37.346402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c499-231c-44de-a9af-1c0031a117f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:37.346685 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c499-231c-44de-a9af-1c0031a117f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:37.346969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01c499-231c-44de-a9af-1c0031a117f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:37.361930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01c499-231c-44de-a9af-1c0031a117f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:37.364032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01c499-231c-44de-a9af-1c0031a117f9 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:37.385306 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1341/2688] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:37.429397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:37.432671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:37.445118 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1348/2689] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:37.706918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:38.599640 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b310-47c9-455c-8318-1490770a92bf None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:38.600432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b310-47c9-455c-8318-1490770a92bf None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:38.600432 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8b310-47c9-455c-8318-1490770a92bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:38.633076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-64d8b310-47c9-455c-8318-1490770a92bf None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:38.635099 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-64d8b310-47c9-455c-8318-1490770a92bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:38.651887 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:38.714945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1342/2690] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:31:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:38.732714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:38.735375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:38.820783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1714e-228f-4c0f-ba2a-b5f58c52d671 service cinder] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:38.827955 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e224115-5469-4d7d-bc21-b64f9d7800f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:38.828633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224115-5469-4d7d-bc21-b64f9d7800f0 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:38.828920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224115-5469-4d7d-bc21-b64f9d7800f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:38.829241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e224115-5469-4d7d-bc21-b64f9d7800f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:38.839279 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e224115-5469-4d7d-bc21-b64f9d7800f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:38.841510 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e224115-5469-4d7d-bc21-b64f9d7800f0 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:38.853531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1349/2691] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:31:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 06:31:41.166721 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8b310-47c9-455c-8318-1490770a92bf None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:41.321395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8b310-47c9-455c-8318-1490770a92bf None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:41.329805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:41.331289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:41.331763 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:41.332226 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] PATH_INFO: `/v3/users/38b448de92ca4f2497b82ebcf6326d37` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:41.334597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b448de92ca4f2497b82ebcf6326d37)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:41.338228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:41.580411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b448de92ca4f2497b82ebcf6326d37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:41.665674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b448de92ca4f2497b82ebcf6326d37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:41.667129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b448de92ca4f2497b82ebcf6326d37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:41.703017 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b448de92ca4f2497b82ebcf6326d37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:41.703921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b448de92ca4f2497b82ebcf6326d37'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:41.722688 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1343/2692] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:41 2022] DELETE /identity/v3/users/38b448de92ca4f2497b82ebcf6326d37 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:31:41.727581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62779980-1c93-4614-a81d-4f39e077257c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:41.728605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62779980-1c93-4614-a81d-4f39e077257c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:41.729112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62779980-1c93-4614-a81d-4f39e077257c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:41.753860 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-62779980-1c93-4614-a81d-4f39e077257c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:41.755131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62779980-1c93-4614-a81d-4f39e077257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:41.910642 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1350/2693] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:31:41.924521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:41.926014 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:42.015220 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:42.040346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0dd1d6-b7c8-476e-b406-0a5c74076279 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:42.040346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb245070-a475-449a-99f8-9db99533901c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:42.040346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb245070-a475-449a-99f8-9db99533901c service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:42.040346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb245070-a475-449a-99f8-9db99533901c service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:42.040813 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb245070-a475-449a-99f8-9db99533901c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:42.057372 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb245070-a475-449a-99f8-9db99533901c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:42.066925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb245070-a475-449a-99f8-9db99533901c service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:42.098564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1344/2694] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:42.829461 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62779980-1c93-4614-a81d-4f39e077257c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:42.831649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-62779980-1c93-4614-a81d-4f39e077257c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:42.847052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62779980-1c93-4614-a81d-4f39e077257c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:42.866858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:42.868397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:42.869352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:42.870892 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] PATH_INFO: `/v3/projects/4ee21eab634f41d485fb122b4fcff87c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:42.872713 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ee21eab634f41d485fb122b4fcff87c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:42.875830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:43.073615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ee21eab634f41d485fb122b4fcff87c', 'request_id': 'req-9ff9736f-8e63-4130-9192-e2e0041acfd6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:43.077727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:43.081454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ee21eab634f41d485fb122b4fcff87c', 'request_id': 'req-9ff9736f-8e63-4130-9192-e2e0041acfd6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:43.215330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ee21eab634f41d485fb122b4fcff87c', 'request_id': 'req-9ff9736f-8e63-4130-9192-e2e0041acfd6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:43.233635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] The token cache is being invalidate because project 4ee21eab634f41d485fb122b4fcff87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:43.233919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:43.235810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9ff9736f-8e63-4130-9192-e2e0041acfd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:43.237920 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1351/2695] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:42 2022] DELETE /identity/v3/projects/4ee21eab634f41d485fb122b4fcff87c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:43.243045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb86979-0526-476d-8b11-dc60ec4b5293 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:43.243598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb86979-0526-476d-8b11-dc60ec4b5293 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:43.243924 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb86979-0526-476d-8b11-dc60ec4b5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:43.274419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-ddb86979-0526-476d-8b11-dc60ec4b5293 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:43.291142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ddb86979-0526-476d-8b11-dc60ec4b5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:43.419818 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1345/2696] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:43.429513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c889-a1e5-4966-aad7-546459a4f79f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:43.429812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c889-a1e5-4966-aad7-546459a4f79f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:43.430098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0c889-a1e5-4966-aad7-546459a4f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:43.452444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-32c0c889-a1e5-4966-aad7-546459a4f79f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:43.454090 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-32c0c889-a1e5-4966-aad7-546459a4f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:43.465032 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1352/2697] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:43.468563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb86979-0526-476d-8b11-dc60ec4b5293 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:43.480252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb86979-0526-476d-8b11-dc60ec4b5293 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:43.486308 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:43.487151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:43.487517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:43.487858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:43.488682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:43.489165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:43.491063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:43.510900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1346/2698] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:31:43.515724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0c889-a1e5-4966-aad7-546459a4f79f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:43.547677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0c889-a1e5-4966-aad7-546459a4f79f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:43.563373 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:43.565085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:43.565595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:43.566138 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:43.567226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:43.570042 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:43.729738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1353/2699] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:43 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:43.734601 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:43.752759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe1c05-e419-44b5-84e0-9908265ffc03 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:43.940674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:43.941514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:43.941803 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:43.942084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:43.942808 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:43.945037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:44.056706 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1347/2700] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:43 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:44.060779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:44.075905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726a2b-92d5-4ac2-aa88-798168a264f1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:44.081228 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:44.082181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:44.082476 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:44.082740 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:44.083504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:44.085156 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:44.101694 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1354/2701] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:44.108520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:44.128321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687932c6-1282-48cb-9356-22de37784cf3 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:44.145852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7c20c-d4cf-4b19-8ca4-cf8017b5aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:44.145852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7c20c-d4cf-4b19-8ca4-cf8017b5aed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:44.145852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7c20c-d4cf-4b19-8ca4-cf8017b5aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:44.145852 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7c20c-d4cf-4b19-8ca4-cf8017b5aed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:44.146667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7c20c-d4cf-4b19-8ca4-cf8017b5aed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:44.146667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7c20c-d4cf-4b19-8ca4-cf8017b5aed4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:44.156024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1348/2702] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:44.161281 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:44.185478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdf942-4763-40da-a092-31ded2e4e474 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:44.196362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:44.198394 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:44.199165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:44.199870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] PATH_INFO: `/v3/projects/239fe831512d4cf2b436bee66190274a/users/ae0d6d26075f442cbe093d0a84ebd708/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:44.232254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=239fe831512d4cf2b436bee66190274a, user_id=ae0d6d26075f442cbe093d0a84ebd708, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:44.235730 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:44.346794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1355/2703] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:44 2022] PUT /identity/v3/projects/239fe831512d4cf2b436bee66190274a/users/ae0d6d26075f442cbe093d0a84ebd708/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:44.352890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:44.353487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:44.353487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:44.394435 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:44.398067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:44.481735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:44.499369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1349/2704] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:44.516282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:44.520732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:44.706506 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269694f-e3f3-470c-be35-1fe07ef5a4a9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:44.711610 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487e84b-9e97-4177-94ba-b8706f8d3dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:44.712290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487e84b-9e97-4177-94ba-b8706f8d3dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:44.712582 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487e84b-9e97-4177-94ba-b8706f8d3dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:44.712866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487e84b-9e97-4177-94ba-b8706f8d3dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:44.738997 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487e84b-9e97-4177-94ba-b8706f8d3dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:44.745252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487e84b-9e97-4177-94ba-b8706f8d3dd3 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:44.764910 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1356/2705] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:51.322173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:51.322173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:51.345910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982788a9-277c-47a7-96f0-39c57eef86d1 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:51.368108 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:51.369858 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:51.370286 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:51.370776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] PATH_INFO: `/v3/users/a37f8dc76f564682b893016651461548` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:51.376199 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a37f8dc76f564682b893016651461548)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:51.379802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:51.705695 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a37f8dc76f564682b893016651461548'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:51.871002 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a37f8dc76f564682b893016651461548'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:51.871988 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a37f8dc76f564682b893016651461548'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:51.888548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a37f8dc76f564682b893016651461548'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:51.889243 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a37f8dc76f564682b893016651461548'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:51.907664 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1350/2706] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:51 2022] DELETE /identity/v3/users/a37f8dc76f564682b893016651461548 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:51.912429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a7e5-88d4-43d0-af55-3a587f57c02a None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:51.913000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a7e5-88d4-43d0-af55-3a587f57c02a None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:51.913000 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a65a7e5-88d4-43d0-af55-3a587f57c02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:51.931890 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-5a65a7e5-88d4-43d0-af55-3a587f57c02a None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:51.934777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5a65a7e5-88d4-43d0-af55-3a587f57c02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:52.019584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1357/2707] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:52.032319 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:52.034300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:52.150870 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26182ee6-9b9d-4fce-ab78-3fe6259725a1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:52.155077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:52.156195 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:52.156500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:52.156777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:52.167075 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:52.168799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:52.180800 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1351/2708] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:31:53.305474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:53.306376 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:53.306654 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:53.344758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] MFA Rules not processed for user `ae0d6d26075f442cbe093d0a84ebd708`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:53.360009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:53.360009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:53.441586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1358/2709] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:53.447041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:53.449022 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:53.493776 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:53.496122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:53.508684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df35a7f2-823d-48b5-a252-79ef0fa814f9 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:53.515358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:53.516084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:53.516497 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:53.517156 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:53.518277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:53.521539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:53.544699 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd34dd-469d-4406-ba98-6c0056776b87 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:53.573897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:53.575487 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:53.576935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:53.577377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] PATH_INFO: `/v3/projects/8b6edeb645954ff48f740411becc41d8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:53.580925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b6edeb645954ff48f740411becc41d8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:53.587436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:53.769131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1352/2710] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:53 2022] POST /identity/v3/projects => generated 385 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:53.775050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:53.791517 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6edeb645954ff48f740411becc41d8', 'request_id': 'req-62f78ece-436e-4e3b-96c8-3d10957ee893'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:53.799844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6edeb645954ff48f740411becc41d8', 'request_id': 'req-62f78ece-436e-4e3b-96c8-3d10957ee893'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:53.870704 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:53.877173 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6edeb645954ff48f740411becc41d8', 'request_id': 'req-62f78ece-436e-4e3b-96c8-3d10957ee893'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:53.898665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7162bff-671b-449d-8442-add8983c0909 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:53.898993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] The token cache is being invalidate because project 8b6edeb645954ff48f740411becc41d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:53.899959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:53.902388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-62f78ece-436e-4e3b-96c8-3d10957ee893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:53.905785 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1359/2711] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:53 2022] DELETE /identity/v3/projects/8b6edeb645954ff48f740411becc41d8 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:53.909872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281331c3-14b3-45fb-8f24-3c389b9f20cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:53.909872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281331c3-14b3-45fb-8f24-3c389b9f20cd admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:53.909872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281331c3-14b3-45fb-8f24-3c389b9f20cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:53.909872 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281331c3-14b3-45fb-8f24-3c389b9f20cd admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:53.910542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281331c3-14b3-45fb-8f24-3c389b9f20cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:53.910542 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281331c3-14b3-45fb-8f24-3c389b9f20cd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:53.913577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892978-cc16-41a9-bcee-7ab7fa858b31 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:53.914152 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892978-cc16-41a9-bcee-7ab7fa858b31 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:53.914758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de892978-cc16-41a9-bcee-7ab7fa858b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:53.949658 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-de892978-cc16-41a9-bcee-7ab7fa858b31 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:53.952028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-de892978-cc16-41a9-bcee-7ab7fa858b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:53.980106 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1360/2712] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:53.981742 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:53.983465 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:53.983893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.019082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:54.021458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:54.038674 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1353/2713] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:53 2022] POST /identity/v3/users => generated 299 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:54.041200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef4a7-ac16-4ee4-af9d-0c3b91f3faf0 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.041554 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef4a7-ac16-4ee4-af9d-0c3b91f3faf0 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.041873 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ef4a7-ac16-4ee4-af9d-0c3b91f3faf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.052414 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1361/2714] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:54.053926 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.056470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:54.081677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc9ac6-bfed-42cc-9856-74b606f5a29f None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.088334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fb0ef4a7-ac16-4ee4-af9d-0c3b91f3faf0 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:54.091818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.093146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fb0ef4a7-ac16-4ee4-af9d-0c3b91f3faf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:54.096410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.096410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.096410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.098449 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.101583 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.144014 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1362/2715] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:54.145050 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.181718 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71600789-9b4d-4d99-9f10-b8252b308dce admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.194282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.195659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.196282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.196886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.198333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:31:54.199025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.202488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.234928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1363/2716] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:31:54.253464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.294332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323260d-6c45-42a0-96bc-1929dbdef984 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.301423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.302468 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.309112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.309112 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] PATH_INFO: `/v3/projects/4332a1b1b0a24d5fb0f482913a5e3926/users/e192ed18719841f5ab2ab742602f0568/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.313005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1354/2717] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 18 06:31:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:54.314748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef4a7-ac16-4ee4-af9d-0c3b91f3faf0 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.333846 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4332a1b1b0a24d5fb0f482913a5e3926, user_id=e192ed18719841f5ab2ab742602f0568, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.336673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.339686 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ef4a7-ac16-4ee4-af9d-0c3b91f3faf0 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.347177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.347971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.350072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.350072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.350072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.351418 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.403429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1364/2718] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:54 2022] PUT /identity/v3/projects/4332a1b1b0a24d5fb0f482913a5e3926/users/e192ed18719841f5ab2ab742602f0568/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:54.407630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.407630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:54.473949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1355/2719] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:31:54 2022] POST /identity/v3/projects => generated 399 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:54.476835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.532916 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da2b35-fcec-47f4-9769-3747aa503f6d admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.579745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04f755-7e08-4dd8-ac8b-871b8024a057 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.586989 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.587749 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.588136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.588546 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.590025 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.592251 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.605181 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1356/2720] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:54.606050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.619012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd97b39-e7b9-462b-ab29-5d880bc62d77 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.625292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.626092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.626451 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.626826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.627779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.630023 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.646364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.647141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.648101 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.648384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.737257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.739466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.753463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1357/2721] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:31:54 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:31:54.754438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1365/2722] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:31:54.754798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.762167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.778373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fb4ef-5f40-46de-bb5c-307662078a25 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.778994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7324fcb-12ea-4dfa-b3a4-298b085dbd85 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.786310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.790114 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.791777 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.792252 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.792742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] PATH_INFO: `/v3/projects/4332a1b1b0a24d5fb0f482913a5e3926/users/e192ed18719841f5ab2ab742602f0568/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.809028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.809028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.809028 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.810300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4332a1b1b0a24d5fb0f482913a5e3926, user_id=e192ed18719841f5ab2ab742602f0568, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.810708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.810708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.811133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:54.831115 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1366/2723] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:54.832708 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:54.838241 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1358/2724] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:54 2022] PUT /identity/v3/projects/4332a1b1b0a24d5fb0f482913a5e3926/users/e192ed18719841f5ab2ab742602f0568/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:54.862239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63952e-5825-4431-a173-17fdf310a059 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:54.883569 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:54.976388 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11e11f1-072f-4d0a-93e3-75a4a20e4bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:54.977677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e11f1-072f-4d0a-93e3-75a4a20e4bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:54.978263 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e11f1-072f-4d0a-93e3-75a4a20e4bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:54.978877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11e11f1-072f-4d0a-93e3-75a4a20e4bd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:54.980451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e11f1-072f-4d0a-93e3-75a4a20e4bd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:54.983424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11e11f1-072f-4d0a-93e3-75a4a20e4bd5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:55.001419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1367/2725] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:31:55.008449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:55.019570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9cc85a-1450-4a7d-b5da-422310f64987 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:55.026180 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:55.027237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:55.027585 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:55.027917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] PATH_INFO: `/v3/projects/9d60154ba79a436aa199ae237b4dc35d/users/babf11407a9a42e8b4dc6cfabe3ff696/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:55.056374 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d60154ba79a436aa199ae237b4dc35d, user_id=babf11407a9a42e8b4dc6cfabe3ff696, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:55.058620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:55.295964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:55.318381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1359/2726] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:31:55 2022] PUT /identity/v3/projects/9d60154ba79a436aa199ae237b4dc35d/users/babf11407a9a42e8b4dc6cfabe3ff696/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:55.333511 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:55.334136 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:55.334703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:55.383959 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] MFA Rules not processed for user `babf11407a9a42e8b4dc6cfabe3ff696`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:31:55.386351 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:55.537005 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1368/2727] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:31:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:31:55.556823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:55.580921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:55.677993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db9073a-7843-490c-97d0-8392b8485a17 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:55.683830 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:55.684553 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:55.684823 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:55.685133 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:55.696642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:55.699978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:55.713005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1360/2728] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:31:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:31:55.981778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:57.242873 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:57.245184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:57.376383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f9721-0d4d-4351-b751-91925ad5aacd None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:57.385402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:57.387387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:57.387883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:57.388436 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] PATH_INFO: `/v3/users/fafd313690244de9b2b534fee6b55146` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:57.392606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafd313690244de9b2b534fee6b55146)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:57.398082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:57.715335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafd313690244de9b2b534fee6b55146'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:57.760509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafd313690244de9b2b534fee6b55146'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:57.778484 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafd313690244de9b2b534fee6b55146'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:57.875800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafd313690244de9b2b534fee6b55146'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:57.876581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafd313690244de9b2b534fee6b55146'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:57.886746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1369/2729] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:57 2022] DELETE /identity/v3/users/fafd313690244de9b2b534fee6b55146 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:59.052722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:59.052722 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c10219-79c6-42c6-98f4-e9a7bfa5b955 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:59.142964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:59.143855 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:59.144171 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:59.144547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] PATH_INFO: `/v3/projects/d20c00f5516f499a98d2dfb93aca606d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:59.146421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d20c00f5516f499a98d2dfb93aca606d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:59.148633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:59.384499 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd20c00f5516f499a98d2dfb93aca606d', 'request_id': 'req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:59.400387 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd20c00f5516f499a98d2dfb93aca606d', 'request_id': 'req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:59.562983 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd20c00f5516f499a98d2dfb93aca606d', 'request_id': 'req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:59.593545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] The token cache is being invalidate because project d20c00f5516f499a98d2dfb93aca606d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:31:59.594848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:59.597710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:31:59.599185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1361/2730] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:31:59 2022] DELETE /identity/v3/projects/d20c00f5516f499a98d2dfb93aca606d => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:31:59.610514 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:31:59.613311 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:31:59.640736 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a76489-765f-4a03-9f68-a18993ffc269 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:31:59.649557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:31:59.738606 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:31:59.739779 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:31:59.740309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:31:59.740695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] PATH_INFO: `/v3/users/d6da369cd9174a85b30cf561f5c53430` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:31:59.742557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6da369cd9174a85b30cf561f5c53430)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:31:59.744866 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:31:59.984547 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6da369cd9174a85b30cf561f5c53430'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:00.032143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6da369cd9174a85b30cf561f5c53430'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:00.066733 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6da369cd9174a85b30cf561f5c53430'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:00.173747 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6da369cd9174a85b30cf561f5c53430'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:00.175285 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-407f5585-66f5-4c68-a828-dd3b3855b4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6da369cd9174a85b30cf561f5c53430'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:00.204257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1370/2731] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:31:59 2022] DELETE /identity/v3/users/d6da369cd9174a85b30cf561f5c53430 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:00.974501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:00.977513 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:01.005598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0edc25-ec91-4f7f-a0b5-8cee3ae777a7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:01.094235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:01.140516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:01.141464 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:01.141746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:01.142032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] PATH_INFO: `/v3/projects/7aad3e895d894634b547e28e0c1f1a3f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:01.143343 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aad3e895d894634b547e28e0c1f1a3f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:01.146076 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:01.287373 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aad3e895d894634b547e28e0c1f1a3f', 'request_id': 'req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:01.297282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aad3e895d894634b547e28e0c1f1a3f', 'request_id': 'req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:01.380042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aad3e895d894634b547e28e0c1f1a3f', 'request_id': 'req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:01.400907 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] The token cache is being invalidate because project 7aad3e895d894634b547e28e0c1f1a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:01.401429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:01.402314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7a3cb3ea-fedd-4900-b8cb-acef85a397d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:01.406222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1362/2732] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:00 2022] DELETE /identity/v3/projects/7aad3e895d894634b547e28e0c1f1a3f => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:01.412863 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85373def-3249-46ca-ad2a-40bb7bbcbee4 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:01.413767 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85373def-3249-46ca-ad2a-40bb7bbcbee4 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:01.414212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85373def-3249-46ca-ad2a-40bb7bbcbee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:01.441543 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-85373def-3249-46ca-ad2a-40bb7bbcbee4 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:01.443333 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-85373def-3249-46ca-ad2a-40bb7bbcbee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:01.542599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1371/2733] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:01.554085 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e138-3560-4018-acfa-7d92558a8d52 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:01.554975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e138-3560-4018-acfa-7d92558a8d52 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:01.556951 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e138-3560-4018-acfa-7d92558a8d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:01.582170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9286e138-3560-4018-acfa-7d92558a8d52 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:01.583621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9286e138-3560-4018-acfa-7d92558a8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:01.595172 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1363/2734] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:01.600253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85373def-3249-46ca-ad2a-40bb7bbcbee4 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:01.616473 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85373def-3249-46ca-ad2a-40bb7bbcbee4 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:01.622025 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:01.623284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:01.623903 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:01.624505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:01.625458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80451) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:32:01.625854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:01.628002 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:01.647933 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1372/2735] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:32:01.649404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286e138-3560-4018-acfa-7d92558a8d52 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:01.661541 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286e138-3560-4018-acfa-7d92558a8d52 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:01.669104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:01.672238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:01.672238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:01.672238 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:01.673730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:01.677694 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:01.815496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1364/2736] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:01 2022] POST /identity/v3/projects => generated 375 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:01.820066 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:01.832496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50755923-ca30-4960-833d-1aa07f1f8d3c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:01.855786 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:01.925143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:01.926062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:01.926264 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:01.926609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] PATH_INFO: `/v3/users` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:01.927399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:01.929546 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:02.063771 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1373/2737] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:01 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:02.068237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:02.079267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7524e4b0-c203-47e8-81e3-c6f6e9a96c29 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:02.084237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:02.084909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:02.085231 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:02.085511 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:02.086237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:02.087916 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:02.101323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1365/2738] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:02.113292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:02.119445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8796a57-533e-47ac-bb2d-06fac5f2475f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:02.126496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40079c3c-0399-41a5-9012-82a281d22629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:02.127202 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40079c3c-0399-41a5-9012-82a281d22629 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:02.127490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40079c3c-0399-41a5-9012-82a281d22629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:02.127772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40079c3c-0399-41a5-9012-82a281d22629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:02.128558 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40079c3c-0399-41a5-9012-82a281d22629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:02.130295 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40079c3c-0399-41a5-9012-82a281d22629 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:02.155129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1374/2739] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:02.157035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:02.202736 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d644e2a-2373-4eab-aa55-a2af2cf0640a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:02.214564 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:02.216945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:02.218269 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:02.219093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] PATH_INFO: `/v3/projects/ae2867d14d794495b4424656a19d5294/users/f62461b73991458c85b387880aa82841/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:02.278809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae2867d14d794495b4424656a19d5294, user_id=f62461b73991458c85b387880aa82841, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:02.282605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:02.502202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1366/2740] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:02 2022] PUT /identity/v3/projects/ae2867d14d794495b4424656a19d5294/users/f62461b73991458c85b387880aa82841/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:02.512181 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:02.513022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:02.513022 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:02.547749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] MFA Rules not processed for user `f62461b73991458c85b387880aa82841`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:02.549243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:02.666097 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1375/2741] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:02.689011 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:02.691024 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:02.807909 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a053e2c-694a-4d2a-8dd9-9262e05fc6db admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:02.813433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a34c5-6fa9-4159-a31b-9d4facf10f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:02.814364 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a34c5-6fa9-4159-a31b-9d4facf10f8c service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:02.814730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a34c5-6fa9-4159-a31b-9d4facf10f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:02.815160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a34c5-6fa9-4159-a31b-9d4facf10f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:02.835636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a34c5-6fa9-4159-a31b-9d4facf10f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:02.839935 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a34c5-6fa9-4159-a31b-9d4facf10f8c service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:02.865913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1367/2742] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:03.381758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:03.383490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:03.531282 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da8279f-c000-44eb-a1df-021da3dfb612 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:03.541306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:03.543312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:03.544194 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:03.545621 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] PATH_INFO: `/v3/users/babf11407a9a42e8b4dc6cfabe3ff696` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:03.548522 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=babf11407a9a42e8b4dc6cfabe3ff696)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:03.552700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:03.773378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:03.927367 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:03.927975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:03.927975 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:03.935394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:03.977315 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] MFA Rules not processed for user `e192ed18719841f5ab2ab742602f0568`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:03.987475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:04.034443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babf11407a9a42e8b4dc6cfabe3ff696'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:04.066964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babf11407a9a42e8b4dc6cfabe3ff696'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:04.102094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babf11407a9a42e8b4dc6cfabe3ff696'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:04.116773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1368/2743] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:32:04.135790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:04.137460 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:04.235267 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9f92-0ef6-4cbf-a245-248fb8391e8d None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:04.239638 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81aa1b5c138247b9b7e0d65fb12af27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:04.240498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:04.241178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:04.241540 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:04.244203 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:04.247789 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babf11407a9a42e8b4dc6cfabe3ff696'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:04.248831 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-3f133140-e5c0-4b14-8d11-a579721224fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babf11407a9a42e8b4dc6cfabe3ff696'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:04.257444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1376/2744] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:32:03 2022] DELETE /identity/v3/users/babf11407a9a42e8b4dc6cfabe3ff696 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:04.261902 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a251a-c9bf-435e-a5e5-8741b7022cb2 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:04.262488 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a251a-c9bf-435e-a5e5-8741b7022cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:04.262948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a251a-c9bf-435e-a5e5-8741b7022cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:04.289672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-454a251a-c9bf-435e-a5e5-8741b7022cb2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:04.291322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-454a251a-c9bf-435e-a5e5-8741b7022cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:04.348717 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:04.350647 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:04.362876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1369/2745] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:32:04.406432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1377/2746] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:04.414365 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:04.416404 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:04.491473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b9ce3-e23a-4ec5-b284-dc395d4edd9b service glance] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:04.563352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:04.564041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:04.564325 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:04.564602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:04.575713 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:04.577490 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:04.588926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1370/2747] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:04.685826 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:04.686354 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:04.686633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:04.706597 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:04.707864 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:04.739093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:04.766294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1378/2748] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:32:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:04.778875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:04.780936 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:04.871158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81ee21-8c91-430d-9bed-4056b1203e17 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:04.877228 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a90275-9936-4959-8189-ce4627e285af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:04.878857 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a90275-9936-4959-8189-ce4627e285af service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:04.879160 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a90275-9936-4959-8189-ce4627e285af service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:04.879439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a90275-9936-4959-8189-ce4627e285af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:04.890496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a90275-9936-4959-8189-ce4627e285af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:04.893235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a90275-9936-4959-8189-ce4627e285af service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:04.906010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1371/2749] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:32:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:32:05.078513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:05.080364 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:05.103088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c71f7-ec07-4c67-a18d-879f756254f3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:05.110552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:05.111714 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:05.112157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:05.112712 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] PATH_INFO: `/v3/projects/9d60154ba79a436aa199ae237b4dc35d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:05.129466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d60154ba79a436aa199ae237b4dc35d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:05.132660 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:05.307848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:05.317335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d60154ba79a436aa199ae237b4dc35d', 'request_id': 'req-f54b437a-cf20-4a61-89ff-2e98f20c816d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:05.327557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d60154ba79a436aa199ae237b4dc35d', 'request_id': 'req-f54b437a-cf20-4a61-89ff-2e98f20c816d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:05.413553 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d60154ba79a436aa199ae237b4dc35d', 'request_id': 'req-f54b437a-cf20-4a61-89ff-2e98f20c816d'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:05.430470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] The token cache is being invalidate because project 9d60154ba79a436aa199ae237b4dc35d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:05.431007 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:05.431868 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-f54b437a-cf20-4a61-89ff-2e98f20c816d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:05.438579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1379/2750] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:05 2022] DELETE /identity/v3/projects/9d60154ba79a436aa199ae237b4dc35d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:05.440277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a00b-4494-49d8-9414-5500555b41e2 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:05.440772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a00b-4494-49d8-9414-5500555b41e2 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:05.440772 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063a00b-4494-49d8-9414-5500555b41e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:05.486210 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-8063a00b-4494-49d8-9414-5500555b41e2 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:05.487656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-8063a00b-4494-49d8-9414-5500555b41e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:05.564781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1372/2751] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:05.572602 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997c47-3877-41fb-a4e0-04c63db9d268 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:05.572950 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997c47-3877-41fb-a4e0-04c63db9d268 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:05.573270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa997c47-3877-41fb-a4e0-04c63db9d268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:05.600245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fa997c47-3877-41fb-a4e0-04c63db9d268 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:05.606676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fa997c47-3877-41fb-a4e0-04c63db9d268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:05.617996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1380/2752] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:32:05.618781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063a00b-4494-49d8-9414-5500555b41e2 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:05.637493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063a00b-4494-49d8-9414-5500555b41e2 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:05.646743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:05.647491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:05.647776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:05.648053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:05.648840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:32:05.649745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:05.651520 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:05.668493 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1373/2753] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:32:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 06:32:05.674151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa997c47-3877-41fb-a4e0-04c63db9d268 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:05.693530 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa997c47-3877-41fb-a4e0-04c63db9d268 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:05.699402 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:05.713013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:05.713013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:05.713013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:05.713013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:05.713013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:05.883048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:05.890383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1381/2754] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:05 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:05.902147 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba853d-95e6-40d3-a2d6-5c07f4f0a8da admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:05.921745 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:06.020437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:06.021972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:06.021972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:06.021972 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:06.022605 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:06.028570 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:06.209039 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1374/2755] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:05 2022] POST /identity/v3/users => generated 287 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:06.216298 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:06.229196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161dcef-45f2-434d-b139-9bbcf0728b2f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:06.234623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:06.235787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:06.235787 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:06.237175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:06.237175 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:06.238609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:06.251134 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1382/2756] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:06.255083 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:06.267789 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd916a1-ec42-4c74-a65b-c967c1290a74 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:06.273246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50583529-ff6c-46ab-b8f6-32f49a1fe1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:06.273920 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583529-ff6c-46ab-b8f6-32f49a1fe1c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:06.274211 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583529-ff6c-46ab-b8f6-32f49a1fe1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:06.274620 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50583529-ff6c-46ab-b8f6-32f49a1fe1c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:06.275358 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50583529-ff6c-46ab-b8f6-32f49a1fe1c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:06.277092 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50583529-ff6c-46ab-b8f6-32f49a1fe1c5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:06.293281 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1375/2757] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:06.296505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:06.317206 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f01f35-0319-4fe4-a518-4e202a3b5c03 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:06.324457 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:06.325387 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:06.325668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:06.326104 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] PATH_INFO: `/v3/projects/875530db3ccc46f7a137eacb29bb516d/users/94f84101426445c5941ae62ee3938a6e/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:06.346062 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875530db3ccc46f7a137eacb29bb516d, user_id=94f84101426445c5941ae62ee3938a6e, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:06.348599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:06.431305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1383/2758] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:06 2022] PUT /identity/v3/projects/875530db3ccc46f7a137eacb29bb516d/users/94f84101426445c5941ae62ee3938a6e/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:06.436934 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688d7a3-513b-4204-89fa-16029e1d0338 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:06.437357 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688d7a3-513b-4204-89fa-16029e1d0338 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:06.437658 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688d7a3-513b-4204-89fa-16029e1d0338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:06.470223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-0688d7a3-513b-4204-89fa-16029e1d0338 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:06.474571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-0688d7a3-513b-4204-89fa-16029e1d0338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:06.589150 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1376/2759] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:06.602371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:06.604627 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:06.738224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c2f44-306d-4d95-9d56-15b2bb3cc600 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:06.743318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:06.744445 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:06.748815 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:06.749897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:06.775423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:06.776936 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:06.810464 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1384/2760] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:14.677850 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413d541-1c17-4b3b-9bb1-5f03bec9fcfe None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:14.678381 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413d541-1c17-4b3b-9bb1-5f03bec9fcfe None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:14.678563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5413d541-1c17-4b3b-9bb1-5f03bec9fcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:14.738598 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-5413d541-1c17-4b3b-9bb1-5f03bec9fcfe None None] MFA Rules not processed for user `94f84101426445c5941ae62ee3938a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:14.740109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5413d541-1c17-4b3b-9bb1-5f03bec9fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:14.856188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1377/2761] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:14.858196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:14.869967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7824587-51d0-4f30-81fb-6318acdd4e14 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:14.876385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:14.877125 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:14.877407 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:14.877687 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:14.878401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:14.880507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:15.018196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1385/2762] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:14 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:15.023239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413d541-1c17-4b3b-9bb1-5f03bec9fcfe None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:15.060388 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5413d541-1c17-4b3b-9bb1-5f03bec9fcfe None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:15.149179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:15.223699 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:15.224400 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:15.224698 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:15.224970 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:15.230262 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:15.235646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:15.361028 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1378/2763] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:15 2022] POST /identity/v3/users => generated 293 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:15.363119 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:15.376305 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe3790-9aac-4c5d-847e-5ff947e246cd admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:15.385948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:15.387026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:15.387483 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:15.387945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:15.389914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:15.391471 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:15.408096 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1386/2764] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:15.408883 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:15.429437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c9946-cc76-4539-817d-4c1b77befcc4 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:15.445342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:15.446349 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:15.446635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:15.446917 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] PATH_INFO: `/v3/projects/dbe36b49040c4239ba6872ce9163407c/users/8b4f54be7cc54c1cb6bda2a6d141ff9e/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:15.473487 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe36b49040c4239ba6872ce9163407c, user_id=8b4f54be7cc54c1cb6bda2a6d141ff9e, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:15.479910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:15.579665 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1379/2765] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:15 2022] PUT /identity/v3/projects/dbe36b49040c4239ba6872ce9163407c/users/8b4f54be7cc54c1cb6bda2a6d141ff9e/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:15.583725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:15.600637 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b0ada7-f1ca-44fa-b870-feb2d09399a5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:15.667429 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:15.697029 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e894-10cd-462d-adba-4f7ca11cf457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:15.697867 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e894-10cd-462d-adba-4f7ca11cf457 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:15.698137 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e894-10cd-462d-adba-4f7ca11cf457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:15.698420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e894-10cd-462d-adba-4f7ca11cf457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:15.699358 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18e894-10cd-462d-adba-4f7ca11cf457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:15.701762 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18e894-10cd-462d-adba-4f7ca11cf457 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:15.725084 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1387/2766] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:15.725908 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:15.742317 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68abdc8-de60-4ff7-9519-52544253ac9d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:15.761094 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:15.762898 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:15.764277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:15.764834 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] PATH_INFO: `/v3/projects/dbe36b49040c4239ba6872ce9163407c/users/8b4f54be7cc54c1cb6bda2a6d141ff9e/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:15.767621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe36b49040c4239ba6872ce9163407c, user_id=8b4f54be7cc54c1cb6bda2a6d141ff9e, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:15.771183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:15.811961 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1380/2767] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:15 2022] PUT /identity/v3/projects/dbe36b49040c4239ba6872ce9163407c/users/8b4f54be7cc54c1cb6bda2a6d141ff9e/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:19.064811 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ac9c9-448d-4397-9c32-9ceec46c3f65 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:19.065338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ac9c9-448d-4397-9c32-9ceec46c3f65 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:19.065830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ac9c9-448d-4397-9c32-9ceec46c3f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:19.097290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-c83ac9c9-448d-4397-9c32-9ceec46c3f65 None None] MFA Rules not processed for user `ae0d6d26075f442cbe093d0a84ebd708`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:19.099382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-c83ac9c9-448d-4397-9c32-9ceec46c3f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:19.259001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1388/2768] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:20.677173 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:20.680093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:20.817313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cc9ce-51d6-4795-ac0e-9fb34466cede admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:20.823196 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:20.824355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:20.825041 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:20.825481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] PATH_INFO: `/v3/users/f62461b73991458c85b387880aa82841` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:20.827237 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f62461b73991458c85b387880aa82841)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:20.830121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:21.119406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f62461b73991458c85b387880aa82841'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:21.207801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f62461b73991458c85b387880aa82841'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:21.208162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f62461b73991458c85b387880aa82841'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:21.226636 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f62461b73991458c85b387880aa82841'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:21.228292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f62461b73991458c85b387880aa82841'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:21.240179 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:21.248507 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1381/2769] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:32:20 2022] DELETE /identity/v3/users/f62461b73991458c85b387880aa82841 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:21.253027 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:21.253523 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:21.253611 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:21.278809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:21.278809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:21.365665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1389/2770] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:21.379783 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:21.381904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:21.635879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8a9c3-2596-4b47-90e4-a039cf9f6117 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:21.643502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd622f-1692-425b-a8d0-f989e0d7c69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:21.645323 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd622f-1692-425b-a8d0-f989e0d7c69d service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:21.645606 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd622f-1692-425b-a8d0-f989e0d7c69d service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:21.645879 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd622f-1692-425b-a8d0-f989e0d7c69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:21.673380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd622f-1692-425b-a8d0-f989e0d7c69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:21.675177 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd622f-1692-425b-a8d0-f989e0d7c69d service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:21.693984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1382/2771] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:22.282588 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:22.284085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:22.304375 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca8df1a-8aae-46aa-b540-83d2273325bc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:22.319825 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:22.324322 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:22.324608 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:22.326738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] PATH_INFO: `/v3/projects/ae2867d14d794495b4424656a19d5294` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:22.331777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae2867d14d794495b4424656a19d5294)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:22.339992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:22.672688 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae2867d14d794495b4424656a19d5294', 'request_id': 'req-e93f6130-a71c-4166-99c5-62c8d6b1ef94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:22.680615 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae2867d14d794495b4424656a19d5294', 'request_id': 'req-e93f6130-a71c-4166-99c5-62c8d6b1ef94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:22.756253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae2867d14d794495b4424656a19d5294', 'request_id': 'req-e93f6130-a71c-4166-99c5-62c8d6b1ef94'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:22.772586 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] The token cache is being invalidate because project ae2867d14d794495b4424656a19d5294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:22.772911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:22.773817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-e93f6130-a71c-4166-99c5-62c8d6b1ef94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:22.776312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1390/2772] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:22 2022] DELETE /identity/v3/projects/ae2867d14d794495b4424656a19d5294 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:23.618761 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:23.619239 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:23.619447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:23.660655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:23.662623 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:23.755013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:23.760009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:23.760009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:23.764369 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1383/2773] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:32:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:23.765623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:23.782448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:23.784569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:23.801338 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] MFA Rules not processed for user `8b4f54be7cc54c1cb6bda2a6d141ff9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:23.802907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:23.915461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ecc605-2aa4-4c7f-aa1e-6b0b609dec21 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:23.927926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2580e1-95f4-405d-bac5-c589148892a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:23.930123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2580e1-95f4-405d-bac5-c589148892a6 service swift] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:23.930123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2580e1-95f4-405d-bac5-c589148892a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:23.930447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2580e1-95f4-405d-bac5-c589148892a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:23.932973 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1391/2774] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:32:23.953911 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2580e1-95f4-405d-bac5-c589148892a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:23.955616 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:23.957993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:23.958428 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2580e1-95f4-405d-bac5-c589148892a6 service swift] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:23.980775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1384/2775] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:32:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:32:24.133283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0e10a-ab5b-4e0c-8b99-28f83a6aece3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:24.147332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:24.148019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:24.148304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:24.148581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:24.150782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:24.323196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:24.329131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:24.385207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1392/2776] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:28.998826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:28.999416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:28.999758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:29.041148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] MFA Rules not processed for user `94f84101426445c5941ae62ee3938a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:29.043526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:29.077045 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1385/2777] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:34.349685 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:36.928494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:36.930065 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:37.001131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcceae-5c4b-4d15-9b8f-89d23171d87f service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:37.004905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:37.005456 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:37.005739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:37.006019 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:37.007861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:37.093774 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:37.097195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:37.107193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1393/2778] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:39.030817 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=87 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:41.969954 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:41.971454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:41.987684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a5db38-2575-434a-95b1-e0fcac320b98 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:41.993121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:41.993272 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:41.993473 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:41.993746 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] PATH_INFO: `/v3/users/6b6c6957d1d54119bbb240a4bfda4b31` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:41.994962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6c6957d1d54119bbb240a4bfda4b31)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:41.997042 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:42.171096 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6c6957d1d54119bbb240a4bfda4b31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:42.247572 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6c6957d1d54119bbb240a4bfda4b31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:42.248602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6c6957d1d54119bbb240a4bfda4b31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:42.265682 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6c6957d1d54119bbb240a4bfda4b31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:42.279296 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-c9003b54-8e5a-4ecd-a0e4-ba7c516deb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6c6957d1d54119bbb240a4bfda4b31'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:42.281866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1386/2779] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:32:41 2022] DELETE /identity/v3/users/6b6c6957d1d54119bbb240a4bfda4b31 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:42.712377 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:42.724794 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2aecf5-0cec-47c4-bbaa-2cf8042546b4 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:42.797763 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:42.798852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:42.799247 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:42.799605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] PATH_INFO: `/v3/projects/ecf7fe2f238b417a80fbec03b7a90f51` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:42.801141 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf7fe2f238b417a80fbec03b7a90f51)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:42.803405 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:43.015409 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf7fe2f238b417a80fbec03b7a90f51', 'request_id': 'req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:43.017435 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:43.021423 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf7fe2f238b417a80fbec03b7a90f51', 'request_id': 'req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:43.225211 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf7fe2f238b417a80fbec03b7a90f51', 'request_id': 'req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:43.236861 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] The token cache is being invalidate because project ecf7fe2f238b417a80fbec03b7a90f51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:43.237172 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:43.237810 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-9d9ea7b9-36f6-44c3-ba70-5b5e76b6b398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:43.239321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1394/2780] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:42 2022] DELETE /identity/v3/projects/ecf7fe2f238b417a80fbec03b7a90f51 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:43.244439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5038-4d0b-40f9-b2b4-0857b3c95d27 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.244940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5038-4d0b-40f9-b2b4-0857b3c95d27 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.245060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b5038-4d0b-40f9-b2b4-0857b3c95d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.266065 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d45b5038-4d0b-40f9-b2b4-0857b3c95d27 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:43.267227 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d45b5038-4d0b-40f9-b2b4-0857b3c95d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:43.330289 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1387/2781] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:43.338664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a644e-01c9-499c-920d-fccd63a0610c None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.338664 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a644e-01c9-499c-920d-fccd63a0610c None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.341319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9a644e-01c9-499c-920d-fccd63a0610c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.358634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-cd9a644e-01c9-499c-920d-fccd63a0610c None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:43.359884 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-cd9a644e-01c9-499c-920d-fccd63a0610c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:43.368383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1395/2782] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:43.375398 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5038-4d0b-40f9-b2b4-0857b3c95d27 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:43.383066 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b5038-4d0b-40f9-b2b4-0857b3c95d27 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:43.389193 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:43.389859 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.390165 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.390443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.391167 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:32:43.391479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:43.393146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:43.406183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1388/2783] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:32:43.410838 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a644e-01c9-499c-920d-fccd63a0610c None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:43.420083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9a644e-01c9-499c-920d-fccd63a0610c None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:43.425366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:43.425366 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.425634 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.425974 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.426649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:43.428507 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:43.528829 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1396/2784] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:43 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:43.532964 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:43.543439 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c240f2-f7c7-47d0-994d-dac80211e8a8 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:43.608483 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:43.609208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.609498 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.609779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.610588 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:43.612574 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:43.619773 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:43.785235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1389/2785] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:43 2022] POST /identity/v3/users => generated 286 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:43.789439 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:43.800591 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc4f55-30e1-408b-8a9e-3d22e97a9f38 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:43.805289 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:43.805948 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.806233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.806510 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.807238 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:43.808858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:43.820384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1397/2786] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:43.824634 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:43.835217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685520fe-1304-48bb-9d7f-bc209df38a38 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:43.840123 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f11c56-a623-449b-a80b-e4cd2471aff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:43.840835 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11c56-a623-449b-a80b-e4cd2471aff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.841200 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11c56-a623-449b-a80b-e4cd2471aff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.841489 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f11c56-a623-449b-a80b-e4cd2471aff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.842223 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f11c56-a623-449b-a80b-e4cd2471aff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:43.843875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f11c56-a623-449b-a80b-e4cd2471aff8 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:43.854350 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1390/2787] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:43.858885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:43.868962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c93360-8a05-4421-ad7f-87d00edd64f1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:43.874286 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:43.875157 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.875437 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.875710 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] PATH_INFO: `/v3/projects/a2d6daaaf6f640709ab5b26bdde5735d/users/9b5f67dd2bf442b493fc336902718b89/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:43.890521 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d6daaaf6f640709ab5b26bdde5735d, user_id=9b5f67dd2bf442b493fc336902718b89, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:43.893257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:43.973813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1398/2788] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:43 2022] PUT /identity/v3/projects/a2d6daaaf6f640709ab5b26bdde5735d/users/9b5f67dd2bf442b493fc336902718b89/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:43.985454 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ecacd-03db-4982-b953-4bd30e4342cc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:43.985766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ecacd-03db-4982-b953-4bd30e4342cc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:43.986082 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ecacd-03db-4982-b953-4bd30e4342cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.016726 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-590ecacd-03db-4982-b953-4bd30e4342cc None None] MFA Rules not processed for user `9b5f67dd2bf442b493fc336902718b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:44.018534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-590ecacd-03db-4982-b953-4bd30e4342cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:44.094868 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1391/2789] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:32:44.103501 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:44.172318 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412e2777-6e11-495e-b35e-abb3fdfb62e4 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:44.177513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:44.178185 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.178490 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.178769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.179491 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:44.181509 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:44.243462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1399/2790] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:44 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:44.247798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ecacd-03db-4982-b953-4bd30e4342cc None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:44.258559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ecacd-03db-4982-b953-4bd30e4342cc None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:44.322801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:44.323576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.323933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.324282 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.325616 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:44.327782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:44.435743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1392/2791] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:44 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:44.439575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:44.451135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb04617-fae2-4220-adfd-dfc4141bbd84 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:44.456438 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:44.456883 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.457201 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.457478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.458219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:44.459850 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:44.473885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1400/2792] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:44.478040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:44.489162 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76858e91-e8a4-44e0-95a6-dd7914d016df admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:44.494590 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:44.495656 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.496008 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.496360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] PATH_INFO: `/v3/projects/1aac58c32ec3402ea30bc03f92e239fb/users/377ffafaf1ce476a972b5f123ab2d817/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.514648 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aac58c32ec3402ea30bc03f92e239fb, user_id=377ffafaf1ce476a972b5f123ab2d817, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:44.517356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:44.598078 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1393/2793] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:44 2022] PUT /identity/v3/projects/1aac58c32ec3402ea30bc03f92e239fb/users/377ffafaf1ce476a972b5f123ab2d817/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:44.601824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:44.613721 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6aa627-2419-4bed-9232-12f6caa38e90 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:44.672578 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:44.683346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491611bf-f316-4326-8c12-1bce5798eee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:44.684032 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491611bf-f316-4326-8c12-1bce5798eee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.684852 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491611bf-f316-4326-8c12-1bce5798eee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.685446 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491611bf-f316-4326-8c12-1bce5798eee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.694991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491611bf-f316-4326-8c12-1bce5798eee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:44.694991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491611bf-f316-4326-8c12-1bce5798eee2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:44.705923 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1401/2794] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:44.707097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:44.718760 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff093a-0bf3-4d0b-bf12-08d7d0fddaea admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:44.723848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:44.724741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.725050 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.725327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] PATH_INFO: `/v3/projects/1aac58c32ec3402ea30bc03f92e239fb/users/377ffafaf1ce476a972b5f123ab2d817/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.727355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aac58c32ec3402ea30bc03f92e239fb, user_id=377ffafaf1ce476a972b5f123ab2d817, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:44.730104 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:44.754137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1394/2795] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:44 2022] PUT /identity/v3/projects/1aac58c32ec3402ea30bc03f92e239fb/users/377ffafaf1ce476a972b5f123ab2d817/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:44.765897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb729-8eac-4c05-99f4-192168db593b None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.766193 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb729-8eac-4c05-99f4-192168db593b None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.766619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6bb729-8eac-4c05-99f4-192168db593b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.803061 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-3a6bb729-8eac-4c05-99f4-192168db593b None None] MFA Rules not processed for user `377ffafaf1ce476a972b5f123ab2d817`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:44.804300 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-3a6bb729-8eac-4c05-99f4-192168db593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:44.895120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1402/2796] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:32:44.909113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:44.910882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:44.935346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:44.983354 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c55d58-5b66-4cf7-b8a0-2584e9a41a4a admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:44.987508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d113f-3692-4c55-b2a4-4d276ccc8283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:44.988276 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d113f-3692-4c55-b2a4-4d276ccc8283 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:44.988559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d113f-3692-4c55-b2a4-4d276ccc8283 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:44.988833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d113f-3692-4c55-b2a4-4d276ccc8283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:44.998967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d113f-3692-4c55-b2a4-4d276ccc8283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:45.000519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d113f-3692-4c55-b2a4-4d276ccc8283 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:45.010383 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1395/2797] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:46.089418 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb729-8eac-4c05-99f4-192168db593b None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:46.167953 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6bb729-8eac-4c05-99f4-192168db593b None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:46.173410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:46.174353 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:46.174641 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:46.174922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] PATH_INFO: `/v3/users/9b5f67dd2bf442b493fc336902718b89` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:46.176144 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b5f67dd2bf442b493fc336902718b89)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:46.178135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:46.391692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b5f67dd2bf442b493fc336902718b89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:46.405341 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b5f67dd2bf442b493fc336902718b89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:46.413074 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b5f67dd2bf442b493fc336902718b89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:46.414854 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:46.485964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b5f67dd2bf442b493fc336902718b89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:46.487035 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b5f67dd2bf442b493fc336902718b89'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:46.495458 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1403/2798] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:32:46 2022] DELETE /identity/v3/users/9b5f67dd2bf442b493fc336902718b89 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:46.500663 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:46.501264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:46.501264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:46.520302 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:46.521568 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:46.590178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1396/2799] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:46.609540 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:46.610924 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:46.674371 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2774f-c5d2-43c5-8c26-cb6ba265c326 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:46.678326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:46.678988 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:46.679273 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:46.679894 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:46.690548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:46.691993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:46.702672 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1404/2800] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:47.219429 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:47.221057 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:47.241477 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356ef90a-774c-45a1-bc92-03d13a03885e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:47.247565 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:47.248569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:47.248894 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:47.249437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] PATH_INFO: `/v3/projects/a2d6daaaf6f640709ab5b26bdde5735d` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:47.250727 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d6daaaf6f640709ab5b26bdde5735d)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:47.252544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:47.440609 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d6daaaf6f640709ab5b26bdde5735d', 'request_id': 'req-daa1ec96-d801-4f24-9443-61e01d4aa66e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:47.446421 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d6daaaf6f640709ab5b26bdde5735d', 'request_id': 'req-daa1ec96-d801-4f24-9443-61e01d4aa66e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:47.531929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:47.533399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:47.542472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d6daaaf6f640709ab5b26bdde5735d', 'request_id': 'req-daa1ec96-d801-4f24-9443-61e01d4aa66e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:47.555836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] The token cache is being invalidate because project a2d6daaaf6f640709ab5b26bdde5735d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80452) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:47.556129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:47.556790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:47.558448 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1397/2801] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:47 2022] DELETE /identity/v3/projects/a2d6daaaf6f640709ab5b26bdde5735d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:47.567925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:47.569472 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:47.624246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:47.643524 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1ec96-d801-4f24-9443-61e01d4aa66e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:47.649006 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:47.649919 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:47.650202 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:47.650478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] PATH_INFO: `/v3/users/377ffafaf1ce476a972b5f123ab2d817` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:47.655356 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=377ffafaf1ce476a972b5f123ab2d817)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:47.659007 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:47.661725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287e789-1d56-41bd-99ca-f060ffa7e711 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:47.756099 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:47.757288 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:47.757808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:47.758319 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:47.766925 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:47.793777 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:47.796425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:47.820073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1405/2802] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:47.931770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '377ffafaf1ce476a972b5f123ab2d817'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:48.007649 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '377ffafaf1ce476a972b5f123ab2d817'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:48.009234 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '377ffafaf1ce476a972b5f123ab2d817'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:48.030029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '377ffafaf1ce476a972b5f123ab2d817'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:48.030891 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3ba8222f-ca56-4f18-b876-11b94419d178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '377ffafaf1ce476a972b5f123ab2d817'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:48.063070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1398/2803] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:32:47 2022] DELETE /identity/v3/users/377ffafaf1ce476a972b5f123ab2d817 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:48.603249 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:48.614812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e004f2d-1507-4404-9ae7-a8139179e0d2 service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:48.618700 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:48.683796 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:48.684881 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:48.685246 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:48.685568 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] PATH_INFO: `/v3/projects/1aac58c32ec3402ea30bc03f92e239fb` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:48.687086 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aac58c32ec3402ea30bc03f92e239fb)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:48.689121 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:48.860808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aac58c32ec3402ea30bc03f92e239fb', 'request_id': 'req-0222df98-44f3-46c8-b44e-565178061241'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:48.866727 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aac58c32ec3402ea30bc03f92e239fb', 'request_id': 'req-0222df98-44f3-46c8-b44e-565178061241'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:48.988197 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aac58c32ec3402ea30bc03f92e239fb', 'request_id': 'req-0222df98-44f3-46c8-b44e-565178061241'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:49.001872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] The token cache is being invalidate because project 1aac58c32ec3402ea30bc03f92e239fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:49.002149 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:49.002844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0222df98-44f3-46c8-b44e-565178061241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:49.004399 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1406/2804] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:48 2022] DELETE /identity/v3/projects/1aac58c32ec3402ea30bc03f92e239fb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:32:49.010240 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e7e0-29bd-418f-a160-ead2055ebbbb None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.011122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e7e0-29bd-418f-a160-ead2055ebbbb None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.011300 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0e7e0-29bd-418f-a160-ead2055ebbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.033417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-a1c0e7e0-29bd-418f-a160-ead2055ebbbb None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:49.034668 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a1c0e7e0-29bd-418f-a160-ead2055ebbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:49.103508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1399/2805] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:49.112166 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427822ec-f06a-4c9c-a1a1-855731a906fc None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.112384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427822ec-f06a-4c9c-a1a1-855731a906fc None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.112674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427822ec-f06a-4c9c-a1a1-855731a906fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.134329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-427822ec-f06a-4c9c-a1a1-855731a906fc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:49.135541 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-427822ec-f06a-4c9c-a1a1-855731a906fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:49.144907 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1407/2806] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:49.149417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0e7e0-29bd-418f-a160-ead2055ebbbb None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:49.160904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0e7e0-29bd-418f-a160-ead2055ebbbb None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:49.166073 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:49.166840 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.167142 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.167406 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.168149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:32:49.168461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:49.170799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:49.188743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1400/2807] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:32:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:32:49.190085 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427822ec-f06a-4c9c-a1a1-855731a906fc None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:49.209278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427822ec-f06a-4c9c-a1a1-855731a906fc None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:49.215226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:49.216174 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.216557 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.216918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.217773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:49.219888 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:49.335262 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1408/2808] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:49 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:49.340130 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:49.354820 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe238b33-8bf3-4491-ba49-a2286ab8ddbe admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:49.423622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:49.432535 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:49.440339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.440339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.440339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.440339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:49.440339 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:49.542169 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1401/2809] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:49 2022] POST /identity/v3/users => generated 282 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:49.550231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:49.574782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bc43c-c1b1-4968-83c4-070e4ba269d9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:49.589526 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:49.591367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.593593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.594154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.595209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:49.599320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:49.624297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1409/2810] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:49.626968 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:49.644654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27d228-b164-4d66-a2b9-902afc98a97f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:49.650395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ef15e-231c-4a0b-8a75-79d0b23dc12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:49.651836 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ef15e-231c-4a0b-8a75-79d0b23dc12e admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.652067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ef15e-231c-4a0b-8a75-79d0b23dc12e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.652333 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ef15e-231c-4a0b-8a75-79d0b23dc12e admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.653839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ef15e-231c-4a0b-8a75-79d0b23dc12e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:49.655666 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ef15e-231c-4a0b-8a75-79d0b23dc12e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:49.669151 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1402/2811] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:32:49.673292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:49.689947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739daa26-f35a-4655-9a59-b0391b3bcc7c admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:49.697741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:49.698744 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.699218 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.699738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] PATH_INFO: `/v3/projects/572f4d08c9df4cffb02f88442d6a5bec/users/bb05ce65c0154d99b2b6060e4810f5a9/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.722590 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] RBAC: Authorizing `identity:create_grant(project_id=572f4d08c9df4cffb02f88442d6a5bec, user_id=bb05ce65c0154d99b2b6060e4810f5a9, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:49.726589 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:49.822390 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1410/2812] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:49 2022] PUT /identity/v3/projects/572f4d08c9df4cffb02f88442d6a5bec/users/bb05ce65c0154d99b2b6060e4810f5a9/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:49.826415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3582ebf-cf65-4fa8-9de8-1d8c175b10f3 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:49.826829 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3582ebf-cf65-4fa8-9de8-1d8c175b10f3 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:49.827230 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3582ebf-cf65-4fa8-9de8-1d8c175b10f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:49.870273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d3582ebf-cf65-4fa8-9de8-1d8c175b10f3 None None] MFA Rules not processed for user `bb05ce65c0154d99b2b6060e4810f5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:49.873921 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d3582ebf-cf65-4fa8-9de8-1d8c175b10f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:49.974402 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1403/2813] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:49 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:49.980928 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:50.048792 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:50.083570 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00954a0-54bd-48bf-adf0-06646ea0441f admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:50.089252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:50.089987 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.090272 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.091111 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.092292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:50.100677 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:50.217797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1411/2814] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:49 2022] POST /identity/v3/projects => generated 365 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:50.229871 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3582ebf-cf65-4fa8-9de8-1d8c175b10f3 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:50.245386 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3582ebf-cf65-4fa8-9de8-1d8c175b10f3 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:50.249661 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:50.252847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:50.345839 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:50.346904 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.347113 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.347380 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.348120 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:50.350246 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:50.380532 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36525498-1acf-480a-bb78-f69ce1ca320a admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:50.390013 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:50.390844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.391254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.391706 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.395480 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:50.451750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1404/2815] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:50 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:50.452776 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:50.464068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfe9e9-1bdf-4337-a9e7-e3dff8c6e310 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:50.472931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:50.472931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.472931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.472931 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.473347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:50.475659 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:50.492485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1405/2816] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:32:50.498249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:50.503196 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:50.505248 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:50.518881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c694d-0ae5-4a96-a235-73bf71a4cc6d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:50.519764 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1412/2817] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:50.524790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:50.525875 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.526264 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.526619 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] PATH_INFO: `/v3/projects/3eb0f900ed974286879ea3f6a365be3c/users/251143647ad84133a0c42e7b0b16da75/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.554396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb0f900ed974286879ea3f6a365be3c, user_id=251143647ad84133a0c42e7b0b16da75, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:50.557278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:50.748893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1406/2818] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:50 2022] PUT /identity/v3/projects/3eb0f900ed974286879ea3f6a365be3c/users/251143647ad84133a0c42e7b0b16da75/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:50.752965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:50.771996 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577609d-46b3-409c-bd5a-ecc1c16a33c1 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:50.845392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e13db-9deb-479c-a2d9-9baabbbbcaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:50.846195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e13db-9deb-479c-a2d9-9baabbbbcaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.846486 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e13db-9deb-479c-a2d9-9baabbbbcaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.846770 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e13db-9deb-479c-a2d9-9baabbbbcaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.847508 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e13db-9deb-479c-a2d9-9baabbbbcaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:50.849410 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e13db-9deb-479c-a2d9-9baabbbbcaf2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:50.861292 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1413/2819] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:50 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:32:50.865885 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:50.879890 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad7199-32b5-400c-bc12-e1cd42ea430e admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:50.885257 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:50.886314 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.886622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.886881 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] PATH_INFO: `/v3/projects/3eb0f900ed974286879ea3f6a365be3c/users/251143647ad84133a0c42e7b0b16da75/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.889979 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eb0f900ed974286879ea3f6a365be3c, user_id=251143647ad84133a0c42e7b0b16da75, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:50.892796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:50.906034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1407/2820] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:50 2022] PUT /identity/v3/projects/3eb0f900ed974286879ea3f6a365be3c/users/251143647ad84133a0c42e7b0b16da75/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:50.917133 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c6db-ff68-48ba-a830-30e9ec04c041 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:50.917600 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c6db-ff68-48ba-a830-30e9ec04c041 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:50.917886 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd6c6db-ff68-48ba-a830-30e9ec04c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:50.943692 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:50.952783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-bfd6c6db-ff68-48ba-a830-30e9ec04c041 None None] MFA Rules not processed for user `251143647ad84133a0c42e7b0b16da75`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:50.954284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bfd6c6db-ff68-48ba-a830-30e9ec04c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:51.051941 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1414/2821] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:32:51.065809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:51.067901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:51.074672 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:51.145141 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53100c0-1840-4631-9a06-66c572fc6c8c admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:51.151055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221afeb-8ee6-49d6-a94e-a37a1a3cc4bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:51.151886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221afeb-8ee6-49d6-a94e-a37a1a3cc4bc service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:51.152174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221afeb-8ee6-49d6-a94e-a37a1a3cc4bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:51.152504 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221afeb-8ee6-49d6-a94e-a37a1a3cc4bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:51.165815 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221afeb-8ee6-49d6-a94e-a37a1a3cc4bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:51.167292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221afeb-8ee6-49d6-a94e-a37a1a3cc4bc service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:51.180146 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1408/2822] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:52.317342 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c6db-ff68-48ba-a830-30e9ec04c041 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:52.404350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd6c6db-ff68-48ba-a830-30e9ec04c041 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:52.409581 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:52.410502 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:52.410782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:52.411056 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] PATH_INFO: `/v3/users/bb05ce65c0154d99b2b6060e4810f5a9` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:52.412278 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb05ce65c0154d99b2b6060e4810f5a9)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:52.414308 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:52.721882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb05ce65c0154d99b2b6060e4810f5a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:52.744016 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb05ce65c0154d99b2b6060e4810f5a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:52.764841 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb05ce65c0154d99b2b6060e4810f5a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:52.886283 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb05ce65c0154d99b2b6060e4810f5a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:52.888153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb05ce65c0154d99b2b6060e4810f5a9'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:52.896220 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1415/2823] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:32:52 2022] DELETE /identity/v3/users/bb05ce65c0154d99b2b6060e4810f5a9 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:52.901192 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:52.901710 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:52.901805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:52.921294 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:52.922526 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:52.987194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1409/2824] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:52.997259 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:52.998797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:53.010550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:53.068146 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c73b-ae11-4e56-86d3-dc03b6819725 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:53.071783 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:53.072466 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:53.072751 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:53.073161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:53.084129 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:53.085693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:53.097593 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1416/2825] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:53.320352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:53.323016 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:53.461055 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02616f6-0c6c-4a6f-8f21-05e13b93a2fd None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:53.468937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:53.469463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:53.469751 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:53.470452 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:53.473678 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:53.499784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:53.501848 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:53.520833 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1410/2826] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:32:53.781312 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:53.788167 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:53.801103 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467f0ea4-74a1-431f-b9f5-cb4f2281473d service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:53.808277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:53.811934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:53.811934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:53.811934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] PATH_INFO: `/v3/projects/572f4d08c9df4cffb02f88442d6a5bec` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:53.811934 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572f4d08c9df4cffb02f88442d6a5bec)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:53.814158 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:53.977715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572f4d08c9df4cffb02f88442d6a5bec', 'request_id': 'req-a06030d5-369b-4d87-9dfc-b6823264f236'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:53.992804 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572f4d08c9df4cffb02f88442d6a5bec', 'request_id': 'req-a06030d5-369b-4d87-9dfc-b6823264f236'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.092943 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572f4d08c9df4cffb02f88442d6a5bec', 'request_id': 'req-a06030d5-369b-4d87-9dfc-b6823264f236'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.118772 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] The token cache is being invalidate because project 572f4d08c9df4cffb02f88442d6a5bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:54.119083 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.122698 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.122918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1417/2827] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:53 2022] DELETE /identity/v3/projects/572f4d08c9df4cffb02f88442d6a5bec => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:54.127602 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:54.138583 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=100 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:54.150990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256a9c6e-e019-4016-9cb0-315e336645d5 service nova] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:54.226275 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:54.230145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:54.230395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:54.230801 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] PATH_INFO: `/v3/users/251143647ad84133a0c42e7b0b16da75` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:54.233913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=251143647ad84133a0c42e7b0b16da75)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:54.236250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:54.455990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '251143647ad84133a0c42e7b0b16da75'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.583250 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '251143647ad84133a0c42e7b0b16da75'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.584221 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '251143647ad84133a0c42e7b0b16da75'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.609311 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '251143647ad84133a0c42e7b0b16da75'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.611997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-aee15d94-d4e1-4a4f-b10e-f79f35464776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '251143647ad84133a0c42e7b0b16da75'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:54.646034 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1411/2828] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:32:54 2022] DELETE /identity/v3/users/251143647ad84133a0c42e7b0b16da75 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:55.141470 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:55.143474 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:55.165819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06030d5-369b-4d87-9dfc-b6823264f236 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:55.232383 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:55.232914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:55.233297 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:55.233649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] PATH_INFO: `/v3/projects/3eb0f900ed974286879ea3f6a365be3c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:55.235033 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eb0f900ed974286879ea3f6a365be3c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:55.237045 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:55.377620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:55.386324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eb0f900ed974286879ea3f6a365be3c', 'request_id': 'req-8ee797dd-4a47-4c48-83a1-2797dda48e3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:55.393231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eb0f900ed974286879ea3f6a365be3c', 'request_id': 'req-8ee797dd-4a47-4c48-83a1-2797dda48e3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:55.498993 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eb0f900ed974286879ea3f6a365be3c', 'request_id': 'req-8ee797dd-4a47-4c48-83a1-2797dda48e3b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:55.516433 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] The token cache is being invalidate because project 3eb0f900ed974286879ea3f6a365be3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:32:55.516797 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:55.517676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8ee797dd-4a47-4c48-83a1-2797dda48e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:32:55.520004 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1418/2829] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:32:55 2022] DELETE /identity/v3/projects/3eb0f900ed974286879ea3f6a365be3c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:55.525888 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff93d9-d7fb-4f4d-9b25-0d606c0f180e None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:55.526401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff93d9-d7fb-4f4d-9b25-0d606c0f180e None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:55.526500 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff93d9-d7fb-4f4d-9b25-0d606c0f180e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:55.546407 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-6bff93d9-d7fb-4f4d-9b25-0d606c0f180e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:55.547613 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-6bff93d9-d7fb-4f4d-9b25-0d606c0f180e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:55.627569 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1412/2830] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:55.630992 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70e15f-1f2a-4335-8b61-c99460c1f04d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:55.631290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70e15f-1f2a-4335-8b61-c99460c1f04d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:55.634304 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70e15f-1f2a-4335-8b61-c99460c1f04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:55.650738 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-8e70e15f-1f2a-4335-8b61-c99460c1f04d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:55.651989 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8e70e15f-1f2a-4335-8b61-c99460c1f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:55.660808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1419/2831] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:55.665342 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff93d9-d7fb-4f4d-9b25-0d606c0f180e None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:55.676596 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff93d9-d7fb-4f4d-9b25-0d606c0f180e None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:55.681543 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:55.682153 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:55.682414 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:55.682687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:55.683431 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:32:55.683735 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:55.686062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:55.698677 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1413/2832] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:32:55.703929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70e15f-1f2a-4335-8b61-c99460c1f04d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:55.713752 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70e15f-1f2a-4335-8b61-c99460c1f04d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:55.719392 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:55.720059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:55.720346 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:55.720618 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:55.721361 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:55.723401 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:55.825519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1420/2833] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:55 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:55.829770 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:55.839843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec5f5f-ce61-46e9-a129-a391501cb086 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:55.848419 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:55.898326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:55.899178 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:55.906443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:55.906443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:55.906443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:55.906443 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:55.990708 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1414/2834] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:55 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:55.995023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.007082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51079b-9262-4f32-aad1-c2aa8d28cbbe admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:56.015577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:56.015577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.015577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.015577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.016707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:56.018814 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:56.037277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1421/2835] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:56.040215 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.053805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659df610-6076-4f48-9f5a-9d6a42fa8958 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:56.059445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2699d5c7-95e5-4552-8941-7ae26a2e9be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:56.059948 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d5c7-95e5-4552-8941-7ae26a2e9be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.060254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d5c7-95e5-4552-8941-7ae26a2e9be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.060508 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2699d5c7-95e5-4552-8941-7ae26a2e9be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.061301 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699d5c7-95e5-4552-8941-7ae26a2e9be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:56.063957 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2699d5c7-95e5-4552-8941-7ae26a2e9be5 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:56.077194 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1415/2836] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:56.083037 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.096309 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d99aee-b228-4f4d-82f9-0448368cae99 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:56.106026 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:56.110329 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.110847 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.111365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] PATH_INFO: `/v3/projects/01239bbb3a7843ffb2181f93ddb20716/users/9e27d88a54f94797a2cb736729fb009f/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.132017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01239bbb3a7843ffb2181f93ddb20716, user_id=9e27d88a54f94797a2cb736729fb009f, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:56.134723 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:56.254505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1422/2837] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:56 2022] PUT /identity/v3/projects/01239bbb3a7843ffb2181f93ddb20716/users/9e27d88a54f94797a2cb736729fb009f/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:56.266062 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998572-3f7a-4c4f-8a00-3ac5cc02d9ed None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.266295 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998572-3f7a-4c4f-8a00-3ac5cc02d9ed None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.266580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35998572-3f7a-4c4f-8a00-3ac5cc02d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.294212 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-35998572-3f7a-4c4f-8a00-3ac5cc02d9ed None None] MFA Rules not processed for user `9e27d88a54f94797a2cb736729fb009f`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:56.295437 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-35998572-3f7a-4c4f-8a00-3ac5cc02d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:56.362077 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1416/2838] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:56.366565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.433142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071f732-638d-4ee8-ad45-ceb15bd728c8 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:56.439239 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:56.439918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.444991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.444991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.444991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:56.444991 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:56.540006 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1423/2839] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:32:56 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:56.540867 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998572-3f7a-4c4f-8a00-3ac5cc02d9ed None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.555137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35998572-3f7a-4c4f-8a00-3ac5cc02d9ed None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:56.643599 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:56.644571 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.644863 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.645176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.645886 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:56.647985 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:56.762949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1417/2840] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:32:56 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:32:56.766869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.778266 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734ebfe-e216-463e-a55a-c1bdea8cc7a2 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:56.783274 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:56.784605 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.785489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.785904 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.786649 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:56.788294 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:56.801044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1424/2841] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:56.805327 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.815990 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464445cc-5c9e-4f33-af6d-068029e1eb5f admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:56.821313 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:56.822318 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:56.822600 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:56.822878 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] PATH_INFO: `/v3/projects/61b0d46642454d27b9825ffc9bff5747/users/c14a62a716cb4176ae6f96c549443e45/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:56.827758 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:56.838744 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b0d46642454d27b9825ffc9bff5747, user_id=c14a62a716cb4176ae6f96c549443e45, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:56.842145 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:56.928651 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1418/2842] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:56 2022] PUT /identity/v3/projects/61b0d46642454d27b9825ffc9bff5747/users/c14a62a716cb4176ae6f96c549443e45/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:56.932813 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:56.947899 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b4e80-4711-476f-9a63-6b1ac5021ed1 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:57.031731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:32:57.067595 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114be042-7f74-4802-b46a-cb69ce58a81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:57.069224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be042-7f74-4802-b46a-cb69ce58a81d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:57.069623 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be042-7f74-4802-b46a-cb69ce58a81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:57.070009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114be042-7f74-4802-b46a-cb69ce58a81d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:57.071021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114be042-7f74-4802-b46a-cb69ce58a81d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:57.072755 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114be042-7f74-4802-b46a-cb69ce58a81d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:57.096367 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1425/2843] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:32:57.096742 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:57.115529 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedcad1-29d0-42f6-af1a-56947555b9b7 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:57.121014 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:57.122527 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:57.122861 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:57.122986 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] PATH_INFO: `/v3/projects/61b0d46642454d27b9825ffc9bff5747/users/c14a62a716cb4176ae6f96c549443e45/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:57.126631 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61b0d46642454d27b9825ffc9bff5747, user_id=c14a62a716cb4176ae6f96c549443e45, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:57.132375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:57.153930 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1419/2844] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:32:57 2022] PUT /identity/v3/projects/61b0d46642454d27b9825ffc9bff5747/users/c14a62a716cb4176ae6f96c549443e45/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:32:57.167131 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:57.167773 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:57.168161 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:57.203579 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] MFA Rules not processed for user `c14a62a716cb4176ae6f96c549443e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:32:57.205667 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:57.313151 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1426/2845] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:32:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:32:57.327544 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:57.329484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:57.399562 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04aed7-ea6c-4fac-84e2-d9f8dc5584b1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:57.405514 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:57.406185 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:57.406475 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:57.406753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:57.483893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:57.485547 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:57.497941 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1420/2846] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:57 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:32:59.230636 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:59.234332 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:59.294299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c86a7-d588-4a93-831f-b5a327e1e955 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:59.301982 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049052aa-ca97-4abf-bbde-9fecaedfa9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:59.303063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049052aa-ca97-4abf-bbde-9fecaedfa9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:59.303219 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049052aa-ca97-4abf-bbde-9fecaedfa9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:59.303555 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049052aa-ca97-4abf-bbde-9fecaedfa9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:59.304100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:32:59.306012 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-049052aa-ca97-4abf-bbde-9fecaedfa9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:59.306248 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:32:59.318303 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4896ff-ddb3-4adc-a469-029df1b35cf2 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:32:59.322136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:32:59.322782 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:32:59.323070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:32:59.323346 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:32:59.333225 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:59.334671 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:59.344847 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1421/2847] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 06:32:59.378819 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049052aa-ca97-4abf-bbde-9fecaedfa9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:32:59.381719 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049052aa-ca97-4abf-bbde-9fecaedfa9a8 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:32:59.391339 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1427/2848] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:32:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:33:03.575853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:03.640545 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237adcd9-b8f9-4ca9-bf95-3a27407b3716 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:03.645737 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:03.646709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:03.646993 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:03.647274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] PATH_INFO: `/v3/users/9e27d88a54f94797a2cb736729fb009f` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:03.648521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e27d88a54f94797a2cb736729fb009f)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:03.650463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:03.665769 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:03.888523 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e27d88a54f94797a2cb736729fb009f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:03.978222 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e27d88a54f94797a2cb736729fb009f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:03.978978 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e27d88a54f94797a2cb736729fb009f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:03.993070 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e27d88a54f94797a2cb736729fb009f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:03.993743 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e27d88a54f94797a2cb736729fb009f'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:04.006939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1422/2849] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:33:03 2022] DELETE /identity/v3/users/9e27d88a54f94797a2cb736729fb009f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:04.011384 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:04.011845 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:04.012036 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:04.024504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:04.030640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:04.031848 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:04.090352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1428/2850] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:04.100136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:04.101607 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:04.160603 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e70390d-c2cf-4a56-82f8-2396ae7ed7a6 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:04.164175 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:04.164819 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:04.165136 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:04.165409 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:04.175218 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:04.176642 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:04.186292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1423/2851] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:33:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:33:04.609391 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:04.610964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:04.625889 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825af36-6124-4382-a6ce-f6e2cb45110d None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:04.630978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:04.631870 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:04.632226 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:04.632513 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] PATH_INFO: `/v3/projects/01239bbb3a7843ffb2181f93ddb20716` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:04.633782 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] RBAC: Authorizing `identity:delete_project(project_id=01239bbb3a7843ffb2181f93ddb20716)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:04.635769 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:04.765254 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01239bbb3a7843ffb2181f93ddb20716', 'request_id': 'req-1d3db782-a1b4-4498-a8ea-07b798d4edea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:04.771063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01239bbb3a7843ffb2181f93ddb20716', 'request_id': 'req-1d3db782-a1b4-4498-a8ea-07b798d4edea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:04.842165 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01239bbb3a7843ffb2181f93ddb20716', 'request_id': 'req-1d3db782-a1b4-4498-a8ea-07b798d4edea'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:04.853965 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] The token cache is being invalidate because project 01239bbb3a7843ffb2181f93ddb20716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:33:04.854253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:04.854897 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:04.856768 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1429/2852] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:33:04 2022] DELETE /identity/v3/projects/01239bbb3a7843ffb2181f93ddb20716 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:04.860949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:04.870781 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032111f-575e-4f7a-82ec-b69cec6aa970 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:04.929621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:04.930485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:04.930768 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:04.931044 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] PATH_INFO: `/v3/users/c14a62a716cb4176ae6f96c549443e45` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:04.932254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c14a62a716cb4176ae6f96c549443e45)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:04.934724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:05.103816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:05.112279 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c14a62a716cb4176ae6f96c549443e45'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.193084 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c14a62a716cb4176ae6f96c549443e45'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.193775 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c14a62a716cb4176ae6f96c549443e45'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.207976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c14a62a716cb4176ae6f96c549443e45'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.208667 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-917b6f6d-6f15-4510-95de-4f6b7d544814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c14a62a716cb4176ae6f96c549443e45'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.222144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1424/2853] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:33:04 2022] DELETE /identity/v3/users/c14a62a716cb4176ae6f96c549443e45 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:05.642969 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:05.644659 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:05.658536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3db782-a1b4-4498-a8ea-07b798d4edea admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:05.720668 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:05.724252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:05.724252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:05.724252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] PATH_INFO: `/v3/projects/61b0d46642454d27b9825ffc9bff5747` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:05.724252 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61b0d46642454d27b9825ffc9bff5747)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:05.725310 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:05.811635 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:05.823234 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61b0d46642454d27b9825ffc9bff5747', 'request_id': 'req-24bf536f-0817-4e18-b73c-45e9c5fe5035'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.829594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61b0d46642454d27b9825ffc9bff5747', 'request_id': 'req-24bf536f-0817-4e18-b73c-45e9c5fe5035'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.904277 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61b0d46642454d27b9825ffc9bff5747', 'request_id': 'req-24bf536f-0817-4e18-b73c-45e9c5fe5035'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.915983 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] The token cache is being invalidate because project 61b0d46642454d27b9825ffc9bff5747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:33:05.916617 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.917335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-24bf536f-0817-4e18-b73c-45e9c5fe5035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:05.922094 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1430/2854] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:33:05 2022] DELETE /identity/v3/projects/61b0d46642454d27b9825ffc9bff5747 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:05.923974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694849c8-acbb-417d-9218-86fca800cb87 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:05.924447 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694849c8-acbb-417d-9218-86fca800cb87 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:05.924559 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694849c8-acbb-417d-9218-86fca800cb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:05.943481 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-694849c8-acbb-417d-9218-86fca800cb87 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:05.947843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-694849c8-acbb-417d-9218-86fca800cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:06.005021 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1425/2855] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:06.014321 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239d04-b598-4f84-b526-f844556acfbe None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.014647 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239d04-b598-4f84-b526-f844556acfbe None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.014930 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36239d04-b598-4f84-b526-f844556acfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.033180 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-36239d04-b598-4f84-b526-f844556acfbe None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:06.034382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-36239d04-b598-4f84-b526-f844556acfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:06.042207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1431/2856] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:06.046866 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694849c8-acbb-417d-9218-86fca800cb87 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.056394 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694849c8-acbb-417d-9218-86fca800cb87 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.062097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.062748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.063031 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.063309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.064029 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:33:06.064334 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.065949 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:06.077392 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1426/2857] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:33:06.081652 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239d04-b598-4f84-b526-f844556acfbe None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.091631 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36239d04-b598-4f84-b526-f844556acfbe None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.096340 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.097020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.097315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.097592 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.098369 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.100378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:06.207044 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1432/2858] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:33:06 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:33:06.211578 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.221548 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc09f57f-88ac-49fc-bd63-95bd2b3583f9 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.278576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.279235 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.279516 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.279790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.280484 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.282411 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:06.376945 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1427/2859] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:33:06 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:33:06.381063 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.392160 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9513-f314-4ab3-9101-6b6ae9f9b9a5 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.397053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.397715 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.397994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.398270 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.399001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.400575 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:06.411817 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1433/2860] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:33:06.415880 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.426723 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f1e97-96bc-460d-8ead-406651cc19fb admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.431355 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7924c-3e09-4c2d-b52c-7b9589c088bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.432012 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7924c-3e09-4c2d-b52c-7b9589c088bd admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.432298 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7924c-3e09-4c2d-b52c-7b9589c088bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.432576 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7924c-3e09-4c2d-b52c-7b9589c088bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.433341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7924c-3e09-4c2d-b52c-7b9589c088bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.434974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7924c-3e09-4c2d-b52c-7b9589c088bd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:06.444997 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1428/2861] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 06:33:06.449347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.459290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66339b15-9f1f-4c3a-8cce-04ae164f4f18 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.463809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.464675 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.465571 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.465978 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] PATH_INFO: `/v3/projects/613ee0969a43466785c95878a7c4b12a/users/958302ddd1c44f56be145d225c8216cb/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.480552 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=613ee0969a43466785c95878a7c4b12a, user_id=958302ddd1c44f56be145d225c8216cb, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.484082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:06.590823 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1434/2862] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:33:06 2022] PUT /identity/v3/projects/613ee0969a43466785c95878a7c4b12a/users/958302ddd1c44f56be145d225c8216cb/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:06.601580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f5b7-a0f3-4d71-b956-0275cb71adb4 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.601876 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f5b7-a0f3-4d71-b956-0275cb71adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.602158 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571f5b7-a0f3-4d71-b956-0275cb71adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.630144 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-7571f5b7-a0f3-4d71-b956-0275cb71adb4 None None] MFA Rules not processed for user `958302ddd1c44f56be145d225c8216cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:06.631362 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7571f5b7-a0f3-4d71-b956-0275cb71adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:06.639622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:06.697126 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1429/2863] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:06.701945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.768231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e4523-9da5-4e0e-b691-6c1d75ec3721 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.773075 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.773735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.774021 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.774299 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.774995 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.776877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:06.898057 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1435/2864] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:33:06 2022] POST /identity/v3/projects => generated 365 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:33:06.902063 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571f5b7-a0f3-4d71-b956-0275cb71adb4 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:06.913461 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571f5b7-a0f3-4d71-b956-0275cb71adb4 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:06.969183 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:06.969882 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:06.970170 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:06.970396 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:06.971090 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:06.973005 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:07.080712 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1430/2865] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:33:06 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:33:07.083947 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:07.095877 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca7852-b2d5-4210-9494-93a3dd743bc9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:07.100702 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:07.101330 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:07.101625 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:07.101905 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:07.102682 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:07.104245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:07.115192 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1436/2866] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:33:07.119594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:07.130278 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ddf033-0821-47cd-9b90-24527237e5a1 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:07.135201 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:07.136072 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:07.136353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:07.136626 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] PATH_INFO: `/v3/projects/02c1d75455464984aa4b8a4508edd08c/users/b283060ff20b4f14abbb23baaf442111/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:07.153938 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c1d75455464984aa4b8a4508edd08c, user_id=b283060ff20b4f14abbb23baaf442111, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:07.156662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:07.282168 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1431/2867] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:33:07 2022] PUT /identity/v3/projects/02c1d75455464984aa4b8a4508edd08c/users/b283060ff20b4f14abbb23baaf442111/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:07.286142 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:07.297267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbeee9-4d4f-4a48-9853-8c49e672f7a9 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:07.327693 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:07.354544 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe6923-6870-4104-911c-086ef0a7379d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:07.355145 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6923-6870-4104-911c-086ef0a7379d admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:07.355424 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6923-6870-4104-911c-086ef0a7379d admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:07.355800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe6923-6870-4104-911c-086ef0a7379d admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:07.356885 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe6923-6870-4104-911c-086ef0a7379d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:07.358504 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe6923-6870-4104-911c-086ef0a7379d admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:07.368478 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1437/2868] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:33:07.373423 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:07.383805 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190dad2d-e5f4-49db-9fdf-7702655a4495 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:07.389347 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:07.390259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:07.390536 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:07.390811 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] PATH_INFO: `/v3/projects/02c1d75455464984aa4b8a4508edd08c/users/b283060ff20b4f14abbb23baaf442111/roles/a30b539353cf42d08ab504edac924aa8` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:07.392790 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02c1d75455464984aa4b8a4508edd08c, user_id=b283060ff20b4f14abbb23baaf442111, role_id=a30b539353cf42d08ab504edac924aa8)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:07.395697 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:07.406124 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1432/2869] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:33:07 2022] PUT /identity/v3/projects/02c1d75455464984aa4b8a4508edd08c/users/b283060ff20b4f14abbb23baaf442111/roles/a30b539353cf42d08ab504edac924aa8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:07.421505 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7559b5-d0a4-4d77-b4e7-1e507a7f7144 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:07.421800 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7559b5-d0a4-4d77-b4e7-1e507a7f7144 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:07.422079 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7559b5-d0a4-4d77-b4e7-1e507a7f7144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:07.453680 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-fb7559b5-d0a4-4d77-b4e7-1e507a7f7144 None None] MFA Rules not processed for user `b283060ff20b4f14abbb23baaf442111`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:07.454935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-fb7559b5-d0a4-4d77-b4e7-1e507a7f7144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:07.528516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1438/2870] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:07.539842 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:07.541799 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:07.603561 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ae9c2-a015-4794-9ff6-c146fce8ef62 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:07.607643 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:07.608236 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:07.608517 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:07.608793 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:07.618733 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:07.620174 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:07.630973 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1433/2871] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:33:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:33:07.844917 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7559b5-d0a4-4d77-b4e7-1e507a7f7144 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:07.854695 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7559b5-d0a4-4d77-b4e7-1e507a7f7144 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:07.858732 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b93ff5-fe55-4dad-bf5a-280f115ea77d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:07.859314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b93ff5-fe55-4dad-bf5a-280f115ea77d service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:07.859594 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b93ff5-fe55-4dad-bf5a-280f115ea77d service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:07.859869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b93ff5-fe55-4dad-bf5a-280f115ea77d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:07.918565 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b93ff5-fe55-4dad-bf5a-280f115ea77d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:07.920619 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b93ff5-fe55-4dad-bf5a-280f115ea77d service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:07.929359 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1439/2872] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:33:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:33:14.691959 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:14.697420 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:14.754741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51957494-c132-4ff1-b91d-e89b6f886c46 service cinder] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:14.759321 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:14.760188 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:14.760478 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:14.760753 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] PATH_INFO: `/v3/users/958302ddd1c44f56be145d225c8216cb` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:14.761976 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=958302ddd1c44f56be145d225c8216cb)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:14.764208 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:15.026932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '958302ddd1c44f56be145d225c8216cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:15.153463 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '958302ddd1c44f56be145d225c8216cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:15.154730 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '958302ddd1c44f56be145d225c8216cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:15.167040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '958302ddd1c44f56be145d225c8216cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:15.167690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '958302ddd1c44f56be145d225c8216cb'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:15.181292 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1434/2873] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:33:14 2022] DELETE /identity/v3/users/958302ddd1c44f56be145d225c8216cb => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:15.186421 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:15.187241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:15.187241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:15.206609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:15.207872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:15.253929 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=100 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:15.268577 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1440/2874] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:15.278691 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:15.281093 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:15.339462 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532401e-b1ec-400d-b77f-57cbae4ef1b2 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:15.344037 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:15.349089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:15.349089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:15.349089 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:15.354905 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:15.356352 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:15.366982 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1435/2875] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:33:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:33:15.802092 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:15.803666 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:15.817550 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcc3095-2dc4-4f4b-829a-75082db5994e None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:15.822549 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:15.823444 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:15.823724 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:15.824633 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] PATH_INFO: `/v3/projects/613ee0969a43466785c95878a7c4b12a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:15.826195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=613ee0969a43466785c95878a7c4b12a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:15.828735 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:15.965147 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '613ee0969a43466785c95878a7c4b12a', 'request_id': 'req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:15.970862 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '613ee0969a43466785c95878a7c4b12a', 'request_id': 'req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.046801 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '613ee0969a43466785c95878a7c4b12a', 'request_id': 'req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.058148 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] The token cache is being invalidate because project 613ee0969a43466785c95878a7c4b12a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:33:16.061064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.061064 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.061323 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1441/2876] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:33:15 2022] DELETE /identity/v3/projects/613ee0969a43466785c95878a7c4b12a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:16.065440 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:16.075157 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769a19a2-0ea8-45a8-8373-c8cc37dfc1bb service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:16.100060 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:16.133491 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:16.134360 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:16.134641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:16.134913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] PATH_INFO: `/v3/users/b283060ff20b4f14abbb23baaf442111` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:16.136100 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b283060ff20b4f14abbb23baaf442111)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:16.138048 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:16.351068 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b283060ff20b4f14abbb23baaf442111'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.429802 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b283060ff20b4f14abbb23baaf442111'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.430433 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b283060ff20b4f14abbb23baaf442111'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.443111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b283060ff20b4f14abbb23baaf442111'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.443759 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7475f17e-3fe8-4adf-9a9b-d43a014bfbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b283060ff20b4f14abbb23baaf442111'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:16.455889 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1436/2877] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:33:16 2022] DELETE /identity/v3/users/b283060ff20b4f14abbb23baaf442111 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:16.952673 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:16.954709 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:16.968489 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff3bdf-e898-4689-87d3-22cd4ac0fcb3 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:17.029749 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:17.030701 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.030976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.031253 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] PATH_INFO: `/v3/projects/02c1d75455464984aa4b8a4508edd08c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.032451 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] RBAC: Authorizing `identity:delete_project(project_id=02c1d75455464984aa4b8a4508edd08c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:17.034382 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:17.178745 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02c1d75455464984aa4b8a4508edd08c', 'request_id': 'req-4a0e3c95-5ac9-4b90-a455-040294e2192b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:17.184208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02c1d75455464984aa4b8a4508edd08c', 'request_id': 'req-4a0e3c95-5ac9-4b90-a455-040294e2192b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:17.263807 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02c1d75455464984aa4b8a4508edd08c', 'request_id': 'req-4a0e3c95-5ac9-4b90-a455-040294e2192b'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:17.275909 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] The token cache is being invalidate because project 02c1d75455464984aa4b8a4508edd08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:33:17.276195 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:17.276837 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-4a0e3c95-5ac9-4b90-a455-040294e2192b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:33:17.278397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1442/2878] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:33:16 2022] DELETE /identity/v3/projects/02c1d75455464984aa4b8a4508edd08c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:33:17.284163 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a980eb-36b2-4463-84dd-72876195e9e6 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.284784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a980eb-36b2-4463-84dd-72876195e9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.284784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a980eb-36b2-4463-84dd-72876195e9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.303967 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-15a980eb-36b2-4463-84dd-72876195e9e6 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:17.305206 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-15a980eb-36b2-4463-84dd-72876195e9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:17.364798 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1437/2879] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:17.372352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdb3a0-d2e0-441f-8a06-c9cde7d88038 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.376143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdb3a0-d2e0-441f-8a06-c9cde7d88038 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.376143 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdb3a0-d2e0-441f-8a06-c9cde7d88038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.381499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:17.392830 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-a3bdb3a0-d2e0-441f-8a06-c9cde7d88038 None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:17.394365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-a3bdb3a0-d2e0-441f-8a06-c9cde7d88038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:17.402233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1443/2880] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:17.407190 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a980eb-36b2-4463-84dd-72876195e9e6 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:17.416755 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a980eb-36b2-4463-84dd-72876195e9e6 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:17.421696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:17.422345 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.422629 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.422901 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.423621 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80452) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 06:33:17.423926 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:17.425530 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:17.437457 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1438/2881] 10.222.0.27 () {58 vars in 1152 bytes} [Mon Jul 18 06:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 06:33:17.441778 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdb3a0-d2e0-441f-8a06-c9cde7d88038 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:17.450790 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdb3a0-d2e0-441f-8a06-c9cde7d88038 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:17.456233 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:17.456898 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.457209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.457707 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] PATH_INFO: `/v3/projects` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.458951 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:17.460876 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:17.556746 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1444/2882] 10.222.0.27 () {60 vars in 1152 bytes} [Mon Jul 18 06:33:17 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 06:33:17.561903 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:17.572341 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1638e-1647-4a41-af06-2d1303d66d6d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:17.602593 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:17.631152 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:17.631826 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.632105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.632377 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] PATH_INFO: `/v3/users` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.633129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:17.635032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:17.759438 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1439/2883] 10.222.0.27 () {60 vars in 1143 bytes} [Mon Jul 18 06:33:17 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 06:33:17.763620 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:17.774404 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361df13c-bf85-4f78-b278-04a2bdea7928 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:17.779023 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:17.782059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.782059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.782059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.782059 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:17.783095 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:17.793791 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1445/2884] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:33:17.798637 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:17.808684 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ade909-23df-4504-a731-a969ddcec35d admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:17.813280 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9c587-fd75-480c-a63d-79064e669d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:17.813932 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c587-fd75-480c-a63d-79064e669d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.814217 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c587-fd75-480c-a63d-79064e669d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.814494 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9c587-fd75-480c-a63d-79064e669d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.815224 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9c587-fd75-480c-a63d-79064e669d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:17.816837 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9c587-fd75-480c-a63d-79064e669d06 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:17.826780 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1440/2885] 10.222.0.27 () {58 vars in 1121 bytes} [Mon Jul 18 06:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 06:33:17.831017 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:17.840784 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77126299-f552-4690-8421-f9816e2c2a02 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:17.845893 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:17.846766 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.847052 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.847326 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] PATH_INFO: `/v3/projects/2d28297d5dbd4b3b9d4131897e77326a/users/993f3f111d8d45f3865a623eb90dc5b1/roles/82e9eb17bbd04cf888953955a1c648af` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.863994 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d28297d5dbd4b3b9d4131897e77326a, user_id=993f3f111d8d45f3865a623eb90dc5b1, role_id=82e9eb17bbd04cf888953955a1c648af)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:17.866665 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:17.933229 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1446/2886] 10.222.0.27 () {60 vars in 1482 bytes} [Mon Jul 18 06:33:17 2022] PUT /identity/v3/projects/2d28297d5dbd4b3b9d4131897e77326a/users/993f3f111d8d45f3865a623eb90dc5b1/roles/82e9eb17bbd04cf888953955a1c648af => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:33:17.938534 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e776f1-8840-4f2b-8cc0-7d216958ebfc None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:17.938827 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e776f1-8840-4f2b-8cc0-7d216958ebfc None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:17.939111 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e776f1-8840-4f2b-8cc0-7d216958ebfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:17.957277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-f4e776f1-8840-4f2b-8cc0-7d216958ebfc None None] MFA Rules not processed for user `20e59e7d825648b8a25362d3fc9a5d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:17.958766 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f4e776f1-8840-4f2b-8cc0-7d216958ebfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:18.019633 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1441/2887] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:33:18.030560 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:18.037009 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:18.090494 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a0151-efad-4627-8bdb-f118379df124 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:18.094760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:18.095408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:18.095691 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:18.095968 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:18.105938 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:18.107385 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:18.118284 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1447/2888] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:33:19.295268 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0eba-ac73-472d-a5ab-be8e204b8c70 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:19.296597 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0eba-ac73-472d-a5ab-be8e204b8c70 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:19.297416 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb0eba-ac73-472d-a5ab-be8e204b8c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:19.330479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-34eb0eba-ac73-472d-a5ab-be8e204b8c70 None None] MFA Rules not processed for user `993f3f111d8d45f3865a623eb90dc5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:19.331974 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-34eb0eba-ac73-472d-a5ab-be8e204b8c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:19.406385 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1442/2889] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:19 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:19.418082 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:33:19.419533 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:19.480519 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8641e2d-f2fa-4567-87fc-585d6161e18c service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:33:19.485432 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17f2a-fa26-4b2f-9ced-735014c85d99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f44e152499fc494085c738c67d0397f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:33:19.486135 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17f2a-fa26-4b2f-9ced-735014c85d99 service cinder] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:19.486420 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17f2a-fa26-4b2f-9ced-735014c85d99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:19.486753 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17f2a-fa26-4b2f-9ced-735014c85d99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:19.496040 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17f2a-fa26-4b2f-9ced-735014c85d99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:33:19.497512 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17f2a-fa26-4b2f-9ced-735014c85d99 service cinder] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:33:19.508548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1448/2890] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:33:19 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:33:21.460962 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60687e5-d35a-43c2-ada6-fa7508278821 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:21.461611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60687e5-d35a-43c2-ada6-fa7508278821 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:21.461611 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60687e5-d35a-43c2-ada6-fa7508278821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:21.479134 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-d60687e5-d35a-43c2-ada6-fa7508278821 None None] MFA Rules not processed for user `993f3f111d8d45f3865a623eb90dc5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:21.480336 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d60687e5-d35a-43c2-ada6-fa7508278821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:21.487725 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1443/2891] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:29.504245 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:31.473913 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:33:39.781378 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] REQUEST_METHOD: `POST` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:33:39.781913 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:33:39.782024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:33:39.800858 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.auth.core [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] MFA Rules not processed for user `993f3f111d8d45f3865a623eb90dc5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80451) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:33:39.802154 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:33:39.813381 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1449/2892] 10.222.0.27 () {58 vars in 957 bytes} [Mon Jul 18 06:33:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:33:49.794812 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=3 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:34:00.498283 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91249-2c7c-449a-a770-1eb9e3ac57de None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:00.498869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91249-2c7c-449a-a770-1eb9e3ac57de None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:00.498869 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f91249-2c7c-449a-a770-1eb9e3ac57de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:00.517552 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-17f91249-2c7c-449a-a770-1eb9e3ac57de None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:34:00.519035 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-17f91249-2c7c-449a-a770-1eb9e3ac57de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:00.581261 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1444/2893] 10.222.0.27 () {58 vars in 1009 bytes} [Mon Jul 18 06:34:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 06:34:00.623931 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:00.625360 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:00.715212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf5767-80a9-40d3-a47d-225bf0dc1ac3 None None] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:00.720209 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:00.720891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:00.721208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:00.721482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:00.731024 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:00.736440 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:00.741120 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1450/2894] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:34:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:34:10.574521 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=25 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:34:10.737748 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=32 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:34:18.422049 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e815-7e27-4df1-ab9a-189c94425181 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:18.422690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e815-7e27-4df1-ab9a-189c94425181 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:18.422690 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1e815-7e27-4df1-ab9a-189c94425181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:18.442229 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-dbb1e815-7e27-4df1-ab9a-189c94425181 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:34:18.443422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-dbb1e815-7e27-4df1-ab9a-189c94425181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:18.451910 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1445/2895] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 18 06:34:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:34:18.464413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:18.477182 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec9052-b106-4b7f-845b-53275945b340 service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:18.482515 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:18.484496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:18.484496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:18.484496 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:18.497314 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:18.498914 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:18.507758 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1451/2896] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:34:21.719748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2a490-b919-4a22-8668-9e46aa7b2190 None None] REQUEST_METHOD: `POST` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:21.719748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2a490-b919-4a22-8668-9e46aa7b2190 None None] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:21.719748 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2a490-b919-4a22-8668-9e46aa7b2190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:21.741933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.auth.core [None req-fde2a490-b919-4a22-8668-9e46aa7b2190 None None] MFA Rules not processed for user `c4d472ed340f4bcdaaf9b30c43b0073c`. Rule list: `[]` (Enabled: `True`). {{(pid=80452) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 06:34:21.743750 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-fde2a490-b919-4a22-8668-9e46aa7b2190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:21.755838 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1446/2897] 10.222.0.27 () {58 vars in 967 bytes} [Mon Jul 18 06:34:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 06:34:21.774536 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:21.787824 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8ea71-865d-4872-80d9-822e86ebdb0d service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:21.793922 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77c35cc610c74f66bc2625dd37dcefe7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:21.794584 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:21.794871 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:21.795153 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:21.804958 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:21.807276 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:21.817397 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1452/2898] 10.222.0.27 () {60 vars in 1384 bytes} [Mon Jul 18 06:34:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 06:34:22.134933 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2a490-b919-4a22-8668-9e46aa7b2190 None None] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:22.147940 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2a490-b919-4a22-8668-9e46aa7b2190 None None] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:22.155809 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:22.157254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:22.157254 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:22.157445 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] PATH_INFO: `/v3/users/993f3f111d8d45f3865a623eb90dc5b1` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:22.158563 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=993f3f111d8d45f3865a623eb90dc5b1)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:22.160485 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:22.452288 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993f3f111d8d45f3865a623eb90dc5b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:22.519010 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993f3f111d8d45f3865a623eb90dc5b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:22.519662 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993f3f111d8d45f3865a623eb90dc5b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:22.536176 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993f3f111d8d45f3865a623eb90dc5b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:22.536928 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993f3f111d8d45f3865a623eb90dc5b1'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:22.551074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1447/2899] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:34:22 2022] DELETE /identity/v3/users/993f3f111d8d45f3865a623eb90dc5b1 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:34:22.836250 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:22.849290 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12f55b-be43-4eb2-ac00-485439a1e5af service swift] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:22.923419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:22.923419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:22.923419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:22.923419 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] PATH_INFO: `/v3/projects/2d28297d5dbd4b3b9d4131897e77326a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:22.923901 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d28297d5dbd4b3b9d4131897e77326a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:22.924236 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:23.076537 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d28297d5dbd4b3b9d4131897e77326a', 'request_id': 'req-bec44c45-666d-45c8-b1c2-24f08ac61621'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:23.082324 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d28297d5dbd4b3b9d4131897e77326a', 'request_id': 'req-bec44c45-666d-45c8-b1c2-24f08ac61621'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:23.166516 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d28297d5dbd4b3b9d4131897e77326a', 'request_id': 'req-bec44c45-666d-45c8-b1c2-24f08ac61621'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:23.179178 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] The token cache is being invalidate because project 2d28297d5dbd4b3b9d4131897e77326a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:34:23.179417 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:23.180053 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:23.182267 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1453/2900] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:34:22 2022] DELETE /identity/v3/projects/2d28297d5dbd4b3b9d4131897e77326a => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:34:31.091594 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:31.093122 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:31.110131 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90094bd3-5692-4ff6-a80f-10bd498e1517 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:31.173579 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:31.174479 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:31.174762 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:31.175116 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] PATH_INFO: `/v3/users/ae0d6d26075f442cbe093d0a84ebd708` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:31.176401 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae0d6d26075f442cbe093d0a84ebd708)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:31.178375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:31.332502 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae0d6d26075f442cbe093d0a84ebd708'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:31.446816 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae0d6d26075f442cbe093d0a84ebd708'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:31.447449 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae0d6d26075f442cbe093d0a84ebd708'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:31.453646 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:34:31.460947 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae0d6d26075f442cbe093d0a84ebd708'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:31.462164 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae0d6d26075f442cbe093d0a84ebd708'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:31.474715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1448/2901] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:34:31 2022] DELETE /identity/v3/users/ae0d6d26075f442cbe093d0a84ebd708 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:34:31.769073 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:31.771347 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:31.793459 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec44c45-666d-45c8-b1c2-24f08ac61621 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:31.863603 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:31.864386 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:31.864674 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:31.864962 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] PATH_INFO: `/v3/projects/239fe831512d4cf2b436bee66190274a` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:31.866190 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=239fe831512d4cf2b436bee66190274a)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:31.868251 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:31.876098 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:34:32.109257 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '239fe831512d4cf2b436bee66190274a', 'request_id': 'req-d82bc86f-6beb-4b17-b271-ee37789c96b6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.128150 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '239fe831512d4cf2b436bee66190274a', 'request_id': 'req-d82bc86f-6beb-4b17-b271-ee37789c96b6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.243935 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '239fe831512d4cf2b436bee66190274a', 'request_id': 'req-d82bc86f-6beb-4b17-b271-ee37789c96b6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.264442 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] The token cache is being invalidate because project 239fe831512d4cf2b436bee66190274a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:34:32.264725 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.265413 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.267184 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1454/2902] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:34:31 2022] DELETE /identity/v3/projects/239fe831512d4cf2b436bee66190274a => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:34:32.271539 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:32.273129 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:32.287059 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6804260-45ef-45de-a50d-170bdb62e378 admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:32.356853 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:32.357796 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:32.358109 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:32.358389 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] PATH_INFO: `/v3/users/e192ed18719841f5ab2ab742602f0568` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:32.359654 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e192ed18719841f5ab2ab742602f0568)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:32.361632 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:32.538353 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e192ed18719841f5ab2ab742602f0568'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.633105 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e192ed18719841f5ab2ab742602f0568'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.633814 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e192ed18719841f5ab2ab742602f0568'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.648410 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e192ed18719841f5ab2ab742602f0568'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.649154 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e192ed18719841f5ab2ab742602f0568'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:32.661900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1449/2903] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:34:32 2022] DELETE /identity/v3/users/e192ed18719841f5ab2ab742602f0568 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:34:32.967132 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:32.978609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:32.984818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bc86f-6beb-4b17-b271-ee37789c96b6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:33.052806 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:33.053640 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:33.054020 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:33.054210 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] PATH_INFO: `/v3/projects/4332a1b1b0a24d5fb0f482913a5e3926` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:33.055671 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4332a1b1b0a24d5fb0f482913a5e3926)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:33.057741 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:33.171231 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4332a1b1b0a24d5fb0f482913a5e3926', 'request_id': 'req-7ab4199d-4f24-41a3-84aa-bb989176d663'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:33.177857 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4332a1b1b0a24d5fb0f482913a5e3926', 'request_id': 'req-7ab4199d-4f24-41a3-84aa-bb989176d663'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:33.232499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4332a1b1b0a24d5fb0f482913a5e3926', 'request_id': 'req-7ab4199d-4f24-41a3-84aa-bb989176d663'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:33.247072 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] The token cache is being invalidate because project 4332a1b1b0a24d5fb0f482913a5e3926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:34:33.247370 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:33.248099 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:34:33.249703 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1455/2904] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:34:32 2022] DELETE /identity/v3/projects/4332a1b1b0a24d5fb0f482913a5e3926 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:34:42.658326 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=62,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:34:43.243350 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:34:58.420653 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:58.422249 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:58.489893 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28f0a0-1c60-4acf-bc0a-8701a85d3bbf admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:58.541660 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:58.548097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:58.548097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:58.548097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:58.548097 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:58.623359 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:58.624741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:58.635724 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1450/2905] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:34:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:34:59.830918 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:34:59.832443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:59.845976 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4199d-4f24-41a3-84aa-bb989176d663 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:34:59.849630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:34:59.850280 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:34:59.850609 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:34:59.850891 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:34:59.852676 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:34:59.867739 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:34:59.869212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:34:59.881425 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1456/2906] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:34:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:35:07.803655 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:35:07.805149 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:35:07.816053 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004ec67-c1e4-48ce-b8be-e24a8a3d6f18 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:35:07.819720 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:35:07.820368 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:35:07.820650 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:35:07.820925 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:35:07.822784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:35:07.832937 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:35:07.834395 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:35:07.842641 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1451/2907] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:35:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:35:09.876482 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:35:11.081139 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:35:11.090472 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4d1cc-2eb6-44ff-bcd7-df5106dedce6 service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:35:11.095043 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:35:11.095306 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:35:11.095498 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:35:11.095681 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:35:11.097882 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:35:11.111760 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:35:11.113443 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:35:11.122566 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1457/2908] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:35:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:35:11.216468 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:35:11.226422 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f6402-3c2f-474b-a87e-d31ae9bd4a6c service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:35:11.230058 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff4923457aa4be498f954c73f4d0018', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:35:11.230696 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:35:11.230980 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:35:11.231259 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:35:11.233067 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:35:11.247015 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:35:11.248375 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:35:11.259309 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1452/2909] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:35:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:35:21.118320 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=6 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:35:21.254549 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=86 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:36:38.341001 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:36:38.342964 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:38.360122 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49392038-bdfa-4cf3-af25-2d3ad769377f service neutron] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:36:38.365638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '065014e1d5984a3db142381ccc62a420', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:36:38.365638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:36:38.365638 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:36:38.366919 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:36:38.368818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:38.382335 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:36:38.383949 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:36:38.396212 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1458/2910] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:36:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:36:43.948533 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:36:43.950135 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:44.025242 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27103d-48fd-44e3-aeef-a0acaa3a3da3 service neutron] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:36:44.030969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:36:44.036635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:36:44.036635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:36:44.036635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:36:44.036635 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:44.046121 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:36:44.047715 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:36:44.058415 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1453/2911] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:36:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:36:47.796462 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:36:47.808599 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5e032-61ad-4fa3-87f7-8810b2ec195b service nova] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:36:47.815352 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:36:47.816207 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] REQUEST_METHOD: `GET` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:36:47.816531 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:36:47.816818 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:36:47.818944 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:47.831485 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:36:47.833396 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:36:47.845972 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1459/2912] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:36:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:36:47.956393 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:36:47.957902 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:48.030417 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c0f7a-7412-41b6-8d98-86d2ba1db88f service placement] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:36:48.035061 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:36:48.035969 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:36:48.036255 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:36:48.036532 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] PATH_INFO: `/v3/users/94f84101426445c5941ae62ee3938a6e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:36:48.037765 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f84101426445c5941ae62ee3938a6e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:36:48.039984 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:36:48.248732 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f84101426445c5941ae62ee3938a6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.320040 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f84101426445c5941ae62ee3938a6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.321020 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f84101426445c5941ae62ee3938a6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.338455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f84101426445c5941ae62ee3938a6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.338455 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f84101426445c5941ae62ee3938a6e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.353779 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1454/2913] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:36:47 2022] DELETE /identity/v3/users/94f84101426445c5941ae62ee3938a6e => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:36:48.636088 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:36:48.650315 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634cc6a7-56c5-4f35-86cc-7d2ed48ccdf9 service placement] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:36:48.714921 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:36:48.715945 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:36:48.716224 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:36:48.716499 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] PATH_INFO: `/v3/projects/875530db3ccc46f7a137eacb29bb516d` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:36:48.718454 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875530db3ccc46f7a137eacb29bb516d)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:36:48.720416 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:36:48.847669 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875530db3ccc46f7a137eacb29bb516d', 'request_id': 'req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.853630 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875530db3ccc46f7a137eacb29bb516d', 'request_id': 'req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.962564 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875530db3ccc46f7a137eacb29bb516d', 'request_id': 'req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.977844 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] The token cache is being invalidate because project 875530db3ccc46f7a137eacb29bb516d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:36:48.978208 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.978911 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:48.980808 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1460/2914] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:36:48 2022] DELETE /identity/v3/projects/875530db3ccc46f7a137eacb29bb516d => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 06:36:48.985807 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:36:48.990274 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:49.005501 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f73a4-3b60-4339-b2da-ca32554469ed admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:36:49.011344 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:36:49.081277 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:36:49.082361 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:36:49.082687 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:36:49.083032 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] PATH_INFO: `/v3/users/8b4f54be7cc54c1cb6bda2a6d141ff9e` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:36:49.084740 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b4f54be7cc54c1cb6bda2a6d141ff9e)` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:36:49.087137 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:36:49.314900 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b4f54be7cc54c1cb6bda2a6d141ff9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:49.399939 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b4f54be7cc54c1cb6bda2a6d141ff9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:49.400580 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b4f54be7cc54c1cb6bda2a6d141ff9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:49.414784 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b4f54be7cc54c1cb6bda2a6d141ff9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:49.415519 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.notifications [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b4f54be7cc54c1cb6bda2a6d141ff9e'} {{(pid=80452) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:49.429074 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1455/2915] 10.222.0.27 () {58 vars in 1223 bytes} [Mon Jul 18 06:36:48 2022] DELETE /identity/v3/users/8b4f54be7cc54c1cb6bda2a6d141ff9e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:36:49.701241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Authenticating user token {{(pid=80451) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:36:49.701241 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.fernet_utils [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80451) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:36:49.718809 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf4ad1-b714-4b75-9e2e-c630fe3caee6 admin admin] Validating token access rules against request {{(pid=80451) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:36:49.794548 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20e59e7d825648b8a25362d3fc9a5d44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a3405aadfe54be0a4fabaa1726d8751', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80451) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:36:49.796077 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:36:49.796362 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:36:49.796645 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] PATH_INFO: `/v3/projects/dbe36b49040c4239ba6872ce9163407c` {{(pid=80451) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:36:49.797967 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe36b49040c4239ba6872ce9163407c)` {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:36:49.799872 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] RBAC: Authorization granted {{(pid=80451) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:36:49.806731 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:36:49.909990 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe36b49040c4239ba6872ce9163407c', 'request_id': 'req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:49.915656 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe36b49040c4239ba6872ce9163407c', 'request_id': 'req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:49.994408 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe36b49040c4239ba6872ce9163407c', 'request_id': 'req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0'} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:50.009365 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] The token cache is being invalidate because project dbe36b49040c4239ba6872ce9163407c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80451) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 06:36:50.009759 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:50.010562 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG keystone.notifications [None req-5d91d85c-64a1-4ce1-b687-abeb49bb0bf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80451) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 06:36:50.012243 dv-cinder-850015-4-smb devstack@keystone.service[80451]: [pid: 80451|app: 0|req: 1461/2916] 10.222.0.27 () {58 vars in 1232 bytes} [Mon Jul 18 06:36:49 2022] DELETE /identity/v3/projects/dbe36b49040c4239ba6872ce9163407c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 06:36:59.425474 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=49,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:37:00.005869 dv-cinder-850015-4-smb devstack@keystone.service[80451]: DEBUG dbcounter [-] [80451] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80451) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 06:37:54.598320 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Authenticating user token {{(pid=80452) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 06:37:54.600148 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:37:54.689709 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24b00b-8ed0-4653-b0f0-854170ed39bd admin admin] Validating token access rules against request {{(pid=80452) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 06:37:54.749622 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9b2e9-a6ca-43f0-9e68-463231855f5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5cb84c685c4840a8958ff1a82f2b6f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de12dff50560499ca0b5cd3165bb22fd', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80452) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 06:37:54.750273 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b2e9-a6ca-43f0-9e68-463231855f5c service placement] REQUEST_METHOD: `GET` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 06:37:54.750561 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b2e9-a6ca-43f0-9e68-463231855f5c service placement] SCRIPT_NAME: `/identity` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 06:37:54.750843 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9b2e9-a6ca-43f0-9e68-463231855f5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80452) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 06:37:54.753496 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.fernet_utils [None req-7ed9b2e9-a6ca-43f0-9e68-463231855f5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80452) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 06:37:54.764884 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b2e9-a6ca-43f0-9e68-463231855f5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 06:37:54.766741 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9b2e9-a6ca-43f0-9e68-463231855f5c service placement] RBAC: Authorization granted {{(pid=80452) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 06:37:54.776971 dv-cinder-850015-4-smb devstack@keystone.service[80452]: [pid: 80452|app: 0|req: 1456/2917] 10.222.0.27 () {60 vars in 1365 bytes} [Mon Jul 18 06:37:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 06:38:04.772456 dv-cinder-850015-4-smb devstack@keystone.service[80452]: DEBUG dbcounter [-] [80452] Writing DB stats keystone:SELECT=58 {{(pid=80452) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}